-- Logs begin at Tue 2022-09-13 07:18:59 UTC, end at Tue 2022-09-13 08:25:09 UTC. -- Sep 13 07:49:45.287495 dv-cinder-857075-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 07:49:45.297182 dv-cinder-857075-3-smb devstack@keystone.service[81507]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 07:49:45 2022] *** Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: nodename: dv-cinder-857075-3-smb Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: machine: x86_64 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: clock source: unix Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: pcre jit disabled Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: detected number of CPU cores: 4 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: current working directory: / Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: detected binary path: /usr/bin/uwsgi-core Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: your processes number limit is 47680 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: your memory page size is 4096 bytes Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: detected max file descriptor number: 2048 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: lock engine: pthread robust mutexes Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: thunder lock: enabled Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 07:49:45.301373 dv-cinder-857075-3-smb devstack@keystone.service[81507]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 07:49:45.338823 dv-cinder-857075-3-smb devstack@keystone.service[81507]: Python main interpreter initialized at 0x562aab5249c0 Sep 13 07:49:45.338823 dv-cinder-857075-3-smb devstack@keystone.service[81507]: python threads support enabled Sep 13 07:49:45.338823 dv-cinder-857075-3-smb devstack@keystone.service[81507]: your server socket listen backlog is limited to 100 connections Sep 13 07:49:45.338823 dv-cinder-857075-3-smb devstack@keystone.service[81507]: your mercy for graceful operations on workers is 90 seconds Sep 13 07:49:45.339154 dv-cinder-857075-3-smb devstack@keystone.service[81507]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 07:49:45.339244 dv-cinder-857075-3-smb devstack@keystone.service[81507]: *** Operational MODE: preforking *** Sep 13 07:49:45.339514 dv-cinder-857075-3-smb devstack@keystone.service[81507]: *** uWSGI is running in multiple interpreter mode *** Sep 13 07:49:45.339514 dv-cinder-857075-3-smb devstack@keystone.service[81507]: spawned uWSGI master process (pid: 81507) Sep 13 07:49:45.339711 dv-cinder-857075-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 07:49:45.340537 dv-cinder-857075-3-smb devstack@keystone.service[81507]: spawned uWSGI worker 1 (pid: 81518, cores: 1) Sep 13 07:49:45.340633 dv-cinder-857075-3-smb devstack@keystone.service[81507]: spawned uWSGI worker 2 (pid: 81519, cores: 1) Sep 13 07:49:45.341152 dv-cinder-857075-3-smb devstack@keystone.service[81507]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 07:49:49.694676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:49:49.694676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: from cryptography.utils import int_from_bytes Sep 13 07:49:49.695483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:49:49.695483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: from cryptography.utils import int_from_bytes Sep 13 07:49:49.696002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:49:49.696002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: from cryptography.utils import int_from_bytes Sep 13 07:49:49.696453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:49:49.696453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: from cryptography.utils import int_from_bytes Sep 13 07:49:49.745763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:49:49.746179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:49:49.746260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:49:49.746354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:49:49.746435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] command line args: [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:49:49.746512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] command line args: [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:49:49.746744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:49:49.746829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:49:49.746911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ================================================================================ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:49:49.747107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ================================================================================ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:49:49.747191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] admin_token = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.747393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] config_dir = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.747544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] admin_token = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.747626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.747751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] config_source = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.747930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] debug = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_dir = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] config_source = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.748928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] debug = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_config_append = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_dir = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.749998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.750864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_config_append = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.751923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_dir = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.752897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.753019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.753260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.753380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.753535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.754387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.754774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.754903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] publish_errors = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.755920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] standard_threads = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.756908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] use_journal = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] use_json = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] use_stderr = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.757918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] use_syslog = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.758498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.758609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.758824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.758947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] publish_errors = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.759086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.759322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.759538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.759650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.759830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.759946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.760094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.760206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.760316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] standard_threads = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.760439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.760564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.760676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.760793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.760904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.761015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.761133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.761319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_journal = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.761319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_json = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.761530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.761640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_stderr = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.761750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.761867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] use_syslog = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.761987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:49:49.762230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.762919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.763970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.764941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.765986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.766962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.767885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.768929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.769948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.770993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.771929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.772917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.773950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.774970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.775794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.776934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.777833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.778925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.779966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.780927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.781930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.782965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.783889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.external = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.784942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.password = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.token = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.785930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.786055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.786453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.786663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.786767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.786916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.787869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.788028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.external = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.788137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.788271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.788376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.password = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.790931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] auth.token = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.791896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.792947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.793916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.794982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.795949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.796924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.797959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.798988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.799937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.800054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.800152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.800280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.800398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.800509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.801991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.802902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.803926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.804924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.805969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.806920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.807900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.808076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.808182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.813938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.814938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.815939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.816082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.816176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.816290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.816883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.816959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.817942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.818932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.819935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] role.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] role.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.820983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.821980 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.822931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.823935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.824889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.825945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.826929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.827972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.828153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.828231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.828386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.832864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.832978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.833979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.834932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.835924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.836992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.837490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:49:49.838830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:49:49.865557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.865781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.866005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.867602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.867837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.868117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.874471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.876438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.907211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.907439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.908962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.909195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.972032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:49.973061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.031907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.032168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.032499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.032735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.197230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.197447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.197671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.197891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.198794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.199014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.199231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.223273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.223401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.223607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.223832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.223917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.224941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.225159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.235876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.236110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.255563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.255797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.255943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81518) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.256963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.257095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.257312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 07:49:50.274056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.274259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 07:49:50.274616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.274935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 07:49:50.275020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 07:49:50.275332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 07:49:50.275847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.275937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.276208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.276469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.276729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.285625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.285901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.286430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.286714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.287277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.287562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.287834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.288138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.293635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.295044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.296635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.296982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.297977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.297977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.297977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.298252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.298929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.299916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.300278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.300575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.301315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.322448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.323915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.324225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.324845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.326323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.326608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.332531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.332531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.332531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.332827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.332827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.332827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.336609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.336894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.339537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.339825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.342534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.342829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.343118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.343405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.343686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.343965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.344260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.344529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.345579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.345881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.346173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.346458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.346734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.347008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.347279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.347643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.360040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.360319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.362915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.363739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.364650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.367536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.380499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.380499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.380642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.380642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.380877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.380962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.381044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.381121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.381194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.382183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.382483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.382772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.383058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.383336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.383616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.396989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.397277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.397580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.397855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.400033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.400325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.400596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.400858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.404670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.406213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.407630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.407728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.408000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.409199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.410834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.411111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.411469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.411653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.411935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.412253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.412644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.414062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.414349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.414634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.414919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.415309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.423767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.424074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.424354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.424631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.425008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.425285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.426179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.426935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.427221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.427505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.427788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.428199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.428556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.428770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.441631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.444195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.444554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.447089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.447457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.448993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.450007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.450504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.450787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.451180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.451507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.452990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.453275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.453682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.458231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.459685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.460611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.462067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.466362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.466683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.471261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.471565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.471846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.473875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.474119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.474404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.478937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81518) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.479218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.479498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.479774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.480074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.480363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.480645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.480921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.481190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.481271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 07:49:50.481465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.481549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.481774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.481856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81518) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.482902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.483184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.483455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.483734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.484120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.484341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.484661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.484933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 07:49:50.517205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562aab5249c0 pid: 81518 (default app) Sep 13 07:49:50.519094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562aab5249c0 pid: 81519 (default app) Sep 13 07:49:50.521256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856675-be12-4ed7-a6a5-051b83cd7d1f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:49:50.521545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856675-be12-4ed7-a6a5-051b83cd7d1f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:49:50.521816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856675-be12-4ed7-a6a5-051b83cd7d1f None None] PATH_INFO: `/v3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:49:50.526035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Sep 13 07:49:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:49:58.264894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:49:58.265443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:49:58.265443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:49:58.270743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:49:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:49:58.276448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:49:58.276847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:49:58.277009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:49:58.349600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: INFO dbcounter [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] Registered counter for database keystone Sep 13 07:49:58.369198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG oslo_db.sqlalchemy.engines [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:49:58.375356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writer thread running {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:49:58.562054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG passlib.handlers.bcrypt [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81518) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 07:49:58.562450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG passlib.handlers.bcrypt [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81518) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 07:49:58.620374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:49:58.622050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:49:58.751783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:49:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 07:49:59.230591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:49:59.302775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: INFO dbcounter [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] Registered counter for database keystone Sep 13 07:49:59.330287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:49:59.336792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writer thread running {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:49:59.459996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c360b-3142-40fe-87a1-05a4e5490505 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:49:59.464235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:49:59.464859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:49:59.465162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:49:59.465431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:49:59.473616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:49:59.524926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 07:49:59.525213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc9101-0639-4e72-99e9-7e99d86317de admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:49:59.534308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Sep 13 07:49:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 07:49:59.540913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:49:59.558087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa542e-c298-4478-b51a-dce65d2186f9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:49:59.562495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:49:59.563606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:49:59.563895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:49:59.564202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] PATH_INFO: `/v3/projects/6e508fcc9dce499eae1e042c37e06fe3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:49:59.565775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] RBAC: Authorizing `identity:get_project(project_id=6e508fcc9dce499eae1e042c37e06fe3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:49:59.618541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING keystone.common.rbac_enforcer.enforcer [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 07:49:59.618878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74067b2f-4ede-4cdc-8a56-8a7217e4602b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:49:59.623375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Sep 13 07:49:59 2022] GET /identity/v3/projects/6e508fcc9dce499eae1e042c37e06fe3 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:01.750916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1fb0-6393-40ee-b750-fe0d2da4cd64 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:01.751433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1fb0-6393-40ee-b750-fe0d2da4cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:01.751521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1fb0-6393-40ee-b750-fe0d2da4cd64 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:01.756394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:01.761722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:01.762190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:01.762276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:01.782246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:01.783773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:01.792308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 07:50:02.068318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1fb0-6393-40ee-b750-fe0d2da4cd64 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:02.080420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1fb0-6393-40ee-b750-fe0d2da4cd64 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:02.085305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:02.085901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:02.086184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:02.086462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:02.094052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:02.095824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c13d5-615d-496a-b681-32980958d0e0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:02.104775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Sep 13 07:50:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:50:02.110182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:02.119481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33a150-ebfd-4f0b-acc8-91ebdf003ad7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:02.123768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:02.124435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:02.124722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:02.125000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:02.126293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:02.128153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8674-6c7a-4713-9441-c2a8da7b518e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:02.130289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Sep 13 07:50:02 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:04.379758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453e16-cf06-4bdb-a5d5-56154efafa77 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.380460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453e16-cf06-4bdb-a5d5-56154efafa77 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.380460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab453e16-cf06-4bdb-a5d5-56154efafa77 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:04.381904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:04.386948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.387333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.387752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:04.388599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630518c-373c-4a3e-896d-d7cfcfa96123 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.388883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630518c-373c-4a3e-896d-d7cfcfa96123 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.389157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630518c-373c-4a3e-896d-d7cfcfa96123 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:04.390376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:04.396519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.396809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.397086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:04.406347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:04.407513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:04.438475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG passlib.handlers.bcrypt [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81519) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 07:50:04.438883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG passlib.handlers.bcrypt [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81519) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 07:50:04.486996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:04.488868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:04.490460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:04.589679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:04.790695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:04.814169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:04.857583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:04.894847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713270b5-5a8f-49d4-8454-538903a4e9ce None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:04.929587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:04.930220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.930503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.930779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:04.942770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:04.951263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:04.952262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:04.953028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:04.956120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:04.958283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:04.958435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ace130-f4c4-402a-8ad6-a978c7b5192f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:04.961557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:04.996526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:04.997420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:04.997709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:04.997984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.041866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:05.060900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605f5a6-26ed-43f9-af41-b4f672c84522 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.075935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.077502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.098285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.098901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.099183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.099456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.100168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:05.100473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.101868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.114228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:05.120635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:05.180669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 07:50:05.186199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:05.188827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:05.224951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79289-9673-46ae-a9a6-5507d73857fc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.259473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.260142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.260430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.260711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.261889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.263382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.265010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:05 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:05.270644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:05.286715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:05.286869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ae4cf-ca52-4a72-93d8-2b65fd6c176c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.321192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.322048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.322475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.322594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.342119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.343589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:50:05.362792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:05.363830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:50:05.364971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:50:05.364971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:50:05.364971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:05.364971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:05.369783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:05.372005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe98e53-d81b-412c-854e-bf228bcc57ac None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.405829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.406450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.406720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.406992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.408145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.409597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.412087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:05.418221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:05.427131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:05.472455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c28f6-577a-4806-b76c-940e983a8969 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.500859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:05.506900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.507519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.508424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.508424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.508740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:05.509044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.510433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd22dd-bf97-4395-81aa-cca84a6a2104 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.520123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3658d-683d-4689-9b07-735f3b0c7da2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:05.527899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:05.556988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:05.557628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:05.557912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:05.558189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:05.558942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.domain.id=default, user.id=3938cf1c8bd54a1e841528f9f40a833f) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:05.559257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:05.560783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c79d-978a-42de-a852-3d0447c0d8f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:05.568996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Sep 13 07:50:05 2022] GET /identity/v3/role_assignments?user.id=3938cf1c8bd54a1e841528f9f40a833f&scope.domain.id=default&role.id=a902366353714eaeb9753ac3ce606c58 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:07.908907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000664-60ea-4f2f-8270-b38ae1fe3cf4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:07.909432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000664-60ea-4f2f-8270-b38ae1fe3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:07.909508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000664-60ea-4f2f-8270-b38ae1fe3cf4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:07.912066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:07.920396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51086b2-00f4-4c4c-884e-766c3dec02fa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:07.920396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51086b2-00f4-4c4c-884e-766c3dec02fa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:07.920396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51086b2-00f4-4c4c-884e-766c3dec02fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:07.945081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b51086b2-00f4-4c4c-884e-766c3dec02fa None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:07.952308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b51086b2-00f4-4c4c-884e-766c3dec02fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:08.037983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:08.339450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81bbd-9446-4456-966e-8e4a39f97851 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.340114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81bbd-9446-4456-966e-8e4a39f97851 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.340601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81bbd-9446-4456-966e-8e4a39f97851 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.342148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:08.347599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.348192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.348307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.376988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:08.378599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:08.469522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:08.604760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81cec-c9f2-4dd5-b8e5-aadc95d94146 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.605306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81cec-c9f2-4dd5-b8e5-aadc95d94146 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.605736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81cec-c9f2-4dd5-b8e5-aadc95d94146 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.607272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 13/26] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:08.607843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:08.611799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:08.612450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee7d1-2e0b-4a08-be3c-0ac851d9df52 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.612742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee7d1-2e0b-4a08-be3c-0ac851d9df52 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.614574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ee7d1-2e0b-4a08-be3c-0ac851d9df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.642942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2a0ee7d1-2e0b-4a08-be3c-0ac851d9df52 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:08.645591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2a0ee7d1-2e0b-4a08-be3c-0ac851d9df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:08.781688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:08.809628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f789-75f4-46c9-aa25-cb501185e5f4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:08.866196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:08.867134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.867561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.868052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.870321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f40-406f-439a-88b8-dd306e6ed26e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.870615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f40-406f-439a-88b8-dd306e6ed26e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.870892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118f40-406f-439a-88b8-dd306e6ed26e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.872569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:08.883539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:08.886934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118f40-406f-439a-88b8-dd306e6ed26e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-57c9783b-f320-4678-8bea-6c92f825d3df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:08.889189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:08.890227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:08.891247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:08.893191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:08.895967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:08.896448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:08.896908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:08.924953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:08.926279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:08.948355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.005393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e118f40-406f-439a-88b8-dd306e6ed26e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.040485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.044859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.045509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.045786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.046054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.053868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 15/30] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:09.054774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.070302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.071781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:50:09.106299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:09.107228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:50:09.108119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:50:09.108119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:50:09.108119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:09.108119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 16/31] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:09.131624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.243180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.247546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b10d-4de6-424e-b550-ba0b6116de67 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.284877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.285985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.286275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.286814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.287743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:09.288085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.289669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:09.293346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012952a-904a-4098-aa81-be0c136f4d7e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.304055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 17/32] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:09.313006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.359474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.360485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.361027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.361507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.362450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:09.363463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.366411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:09.388293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 16/33] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:09.389402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.480791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.490112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2aa848-41cd-4947-8da8-0393fd7991cd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.529769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44045-cd07-4c37-bbe7-3eb2c22140b7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.533990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.535257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.535717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.536165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.537430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.538989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:09.568869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.569736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.570162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.570636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.571516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.573058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:09.784098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 18/34] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:50:09 2022] POST /identity/v3/projects => generated 301 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:09.784637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 17/35] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 07:50:09 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:09.786817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.794121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:09.823426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.942587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f91f3-8eb6-4751-acf6-4fe4807e6c4c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:09.965590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:09.990255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:09.991392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:09.991830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:09.992314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:09.993299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:09.996385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3435f0d-e2f9-4fa3-9e00-8780d54c83cc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.052199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b158-6640-4f49-90f5-bdb13e15e4a3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.082915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 18/36] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 07:50:09 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:10.084426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f416-8a5b-4ff0-a5e3-e8527a169dba None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.084760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f416-8a5b-4ff0-a5e3-e8527a169dba None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.085050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436f416-8a5b-4ff0-a5e3-e8527a169dba None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.086293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 19/37] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:10.094745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-5106-4425-b756-a67d573e3921 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.095044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-5106-4425-b756-a67d573e3921 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.095310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5e74f-5106-4425-b756-a67d573e3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.103873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.104600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.104889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.105172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.108435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.110076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.111965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:09 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:10.119697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:10.136787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1ee5e74f-5106-4425-b756-a67d573e3921 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:10.138411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1ee5e74f-5106-4425-b756-a67d573e3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:10.221997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:10.237462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 20/39] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:10.237462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3497c-855a-41ca-8bc6-800e9e571317 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.237462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3497c-855a-41ca-8bc6-800e9e571317 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.237462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3497c-855a-41ca-8bc6-800e9e571317 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.237462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 21/40] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:10.242834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.243018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.243395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.257981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95609-f91f-4789-955b-a8f13be096a4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.267748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:10.269285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:10.308831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.309773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.310132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.310484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.311887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.313368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.315154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 20/41] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:10.321184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:10.350558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:10.441699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6420-9b3b-4fe4-ad46-d3f530577a8d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.476052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.476960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.477420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.477869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] PATH_INFO: `/v3/domains/default/users/3938cf1c8bd54a1e841528f9f40a833f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.479998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3938cf1c8bd54a1e841528f9f40a833f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.481621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.509308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:10.544508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:10.585147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Sep 13 07:50:10 2022] PUT /identity/v3/domains/default/users/3938cf1c8bd54a1e841528f9f40a833f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:10.633335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:10.643600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:10.733555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17408ef-1e6f-4e14-a44b-7e07693cd24e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.758466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987148-e1e7-4973-94ba-03d50cf6d783 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.774669 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.775605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.775860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.776165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.776845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.778781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d141-3d0c-4e19-9eb1-2d11ca62e096 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.798970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.799734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.800104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.800484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.801732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.803171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:10.804810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 22/44] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:10.810340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:10.853521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 07:50:10 2022] POST /identity/v3/roles => generated 223 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:50:10.887810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:10.919526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cc64c-161f-43b5-9fbf-6b4ff00c85de None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:10.958896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:10.959537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:10.959827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:10.960184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:10.960858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:10.962375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076bf4a-f48a-4405-a928-b565b2dfbe83 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:11.041556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:50:10 2022] POST /identity/v3/projects => generated 312 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:50:12.764855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295b28-0b69-4858-8a40-bcf2911bf3de None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:12.765371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295b28-0b69-4858-8a40-bcf2911bf3de None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:12.765470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295b28-0b69-4858-8a40-bcf2911bf3de None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:12.766757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:12.772260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f494-1645-41ca-aff1-0b0808ae2b16 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:12.772689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f494-1645-41ca-aff1-0b0808ae2b16 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:12.772792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f494-1645-41ca-aff1-0b0808ae2b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:12.791434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0ce5f494-1645-41ca-aff1-0b0808ae2b16 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:12.792982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0ce5f494-1645-41ca-aff1-0b0808ae2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:12.858408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:13.130802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295b28-0b69-4858-8a40-bcf2911bf3de None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.231439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:13.238304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295b28-0b69-4858-8a40-bcf2911bf3de None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.266570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aada67-8ad5-4c8a-8db1-cff60c632175 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.266941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aada67-8ad5-4c8a-8db1-cff60c632175 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.267228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aada67-8ad5-4c8a-8db1-cff60c632175 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.268647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 25/49] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:13.275333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.275333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.276069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.276162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.276228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.276228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.276339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.288127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:13.293294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:13.294196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:13.294976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:13.295599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:13.295667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 25/50] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:13.295741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:13.300139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.344235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:13.361184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 26/51] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:13.410853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993e20-148e-4883-ba77-b879c9e18d7d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.444451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.445064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.445348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.445627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.446295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:13.446607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:13.448046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:13.455920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 26/52] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:13.462317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.557937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737c94-891c-44d8-85f0-91b5840b8214 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.590076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.590702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.590987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.591264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.592405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:13.593851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:13.595429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:13.601008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.620797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:13.639150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.695365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:13.703410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cea0-0742-4db1-a6ad-43e686afbc17 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.737530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddfa97-5e27-4835-b5a5-22bbbf737036 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.743689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.744369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.744651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.744925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.746057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:13.747524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:13.749148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 27/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:13.755610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.778364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.778900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.778980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.779302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.780369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:13.781827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:13.783529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:13.792895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:13.840637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:13.855465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490bd88-19c6-41eb-a0e0-715ce4e43383 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.892118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bea6-1655-4934-8a36-d640b019c8f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:13.892534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:13.893146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:13.893437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:13.893717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:13.895554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.domain.id=default, user.id=3938cf1c8bd54a1e841528f9f40a833f) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:13.895869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:13.897355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f4-29f5-4ff4-8154-f44c694d8ed4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:13.903736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 28/56] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Sep 13 07:50:13 2022] GET /identity/v3/role_assignments?user.id=3938cf1c8bd54a1e841528f9f40a833f&scope.domain.id=default&role.id=a902366353714eaeb9753ac3ce606c58 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:14.023539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:14.035218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:14.036035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:14.036319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:14.036858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:14.037536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:14.039026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731510b-a280-4b0c-8ea4-8195f60d9c66 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:14.145984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 29/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Sep 13 07:50:13 2022] POST /identity/v3/projects => generated 298 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:50:16.369153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa900-0e81-4d90-9799-8a3d568b7c46 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:16.369685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa900-0e81-4d90-9799-8a3d568b7c46 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:16.369789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa900-0e81-4d90-9799-8a3d568b7c46 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:16.371048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:16.376452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:16.376809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:16.377014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:16.397320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:16.398550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:16.464508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:16.737175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa900-0e81-4d90-9799-8a3d568b7c46 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:16.834804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa900-0e81-4d90-9799-8a3d568b7c46 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:16.866857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:16.867468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:16.867746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:16.868041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:16.869125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:16.870552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f19963-b754-4923-a244-9723abe0135e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:16.872104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:16.877701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:16.974136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb03c9-cdff-4a95-81b3-a2b5a92bccd6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:16.976623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:17.012041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:17.012596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:17.012877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:17.013151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:17.013792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:17.015220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19fa62-0024-4a70-a9f6-ee2080bebf46 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:17.114929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:16 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:20.531658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37f555-00a2-4d44-ba3d-47d0520e5212 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.532506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37f555-00a2-4d44-ba3d-47d0520e5212 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.532953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37f555-00a2-4d44-ba3d-47d0520e5212 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.534976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:20.540761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1452-c36a-4104-aa17-e74bf3ad1049 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.540991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42595-91c1-4c63-8f09-7d1e087710b5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.541369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42595-91c1-4c63-8f09-7d1e087710b5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.541369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42595-91c1-4c63-8f09-7d1e087710b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.541964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1452-c36a-4104-aa17-e74bf3ad1049 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.542502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1452-c36a-4104-aa17-e74bf3ad1049 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.544016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:20.560444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9be42595-91c1-4c63-8f09-7d1e087710b5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:20.561624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105b4c2-c3df-48b8-8ecc-b1fdd8c59cfc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.561915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105b4c2-c3df-48b8-8ecc-b1fdd8c59cfc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.562196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105b4c2-c3df-48b8-8ecc-b1fdd8c59cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.562618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9be42595-91c1-4c63-8f09-7d1e087710b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:20.600987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1105b4c2-c3df-48b8-8ecc-b1fdd8c59cfc None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:20.602190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1105b4c2-c3df-48b8-8ecc-b1fdd8c59cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:20.631241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:20.635289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:20.725941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:20.850523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4270-d25f-4832-aaa4-3696fd9d293e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.851195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4270-d25f-4832-aaa4-3696fd9d293e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.851683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4270-d25f-4832-aaa4-3696fd9d293e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.853281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 33/66] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:20.858414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:20.858957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:20.859458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:20.884312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:20.885794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:20.976346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 34/67] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:20.990925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4270-d25f-4832-aaa4-3696fd9d293e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.055948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.118000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.131678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4270-d25f-4832-aaa4-3696fd9d293e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.170079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.177250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.178458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.179076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.179500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.193719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604feb8e-a626-4252-b943-5d1958c9c231 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.195121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a0f1272f-6b59-4ca8-807a-62c97d9c2509 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:21.203716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:21.204802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:21.205653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:21.207642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 34/68] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d01f-47b2-429b-b014-2b1e6e419978 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d01f-47b2-429b-b014-2b1e6e419978 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391d01f-47b2-429b-b014-2b1e6e419978 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 35/69] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf5f8-4101-48a0-9901-8743d8f434c2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.215965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf5f8-4101-48a0-9901-8743d8f434c2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.216452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf5f8-4101-48a0-9901-8743d8f434c2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.216452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 36/70] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:21.216452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf5f8-4101-48a0-9901-8743d8f434c2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.240549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.241429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.241712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.241987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.252704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cf09665e-0891-4e5d-9942-34c5342ce925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:21.258073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:21.258938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:21.259695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:21.264918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0698e-fab8-4e9a-beef-c51e1c3069c6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.265764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0698e-fab8-4e9a-beef-c51e1c3069c6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.266058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0698e-fab8-4e9a-beef-c51e1c3069c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.286996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-90c0698e-fab8-4e9a-beef-c51e1c3069c6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:21.288212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-90c0698e-fab8-4e9a-beef-c51e1c3069c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:21.330160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf5f8-4101-48a0-9901-8743d8f434c2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.353783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 36/72] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:21.355011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.355307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.355588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.364771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.365385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.365665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.365937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.366597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:21.366899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.368798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.373462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:21.374673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:21.387601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.387601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.403148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.442664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.448424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 37/74] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:21.449372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.506707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7ff3-d17c-4fb6-9348-843782206b96 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.550233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.551375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.552106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.552395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.553340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:21.553648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.555040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.555151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3703-2e8b-4a04-b0f0-d9935a1abe9b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.563860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.564702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.594920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.595793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.596244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.596616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.607971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:21.613236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:21.615036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:21.616969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.650765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.676617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b168f7-b4bb-4c57-89e8-6c8248ebd067 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.680530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.714590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.715362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.715660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.715937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.717233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.718792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.722058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43b218-7e48-4d01-8c85-0fcb6a2b9d5a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.725727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.726567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.756990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.757625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.757905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.758179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.771643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.773138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.774744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.775497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.828806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d51b2e-cf1e-4973-b39a-32ab6264e4ea None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.862606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.863326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.863619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.863900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.864596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:21.864905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.866289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.874530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542fb5-50e7-497a-b617-5270612820d1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:21.874657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.875322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.880518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.891556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:21.909183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:21.909978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:21.910258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:21.910530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:21.911907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:21.913372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:21.914927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:21.914927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:21.980087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aafa6-dac2-4c46-803a-3117d3343e72 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.012119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3415-8b8e-4005-abc4-f2da911e7e15 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.013409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.014020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.014297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.014572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.046040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.046692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.046977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.047257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.057954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:22.063230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:22.064308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:22.065075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:22.066259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.085488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.086965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.089576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.111154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.176207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c138c1-c837-45e1-994f-7eb7917eb09d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.189739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:22.190580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.210246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.210855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.211140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.211419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.280768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.282268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.296294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2c31-803a-4ce7-892e-9f3b176a3eb5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.298594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.326852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.330585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.331217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.332133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.332368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.333489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.334964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.336566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:22.337301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.386552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:22.387393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.438780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f40e-b010-4302-b7e2-6db1e24ae68c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.474891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.475506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.475784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.476085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.476758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.478180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.483660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc81a05-ac53-46c7-ac52-358c6012cb38 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.517061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.517668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.517948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.518221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.518988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:22.519338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.520735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.528409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:22.529173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.538038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.577318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 43/86] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:22 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:22.586098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.610877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.649579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1101f-4556-4a61-9edd-26ab846ff8da None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.688968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.689536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.689812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.690091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.691817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.693529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.700337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:22.700512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c24a1-0b64-4786-b8c8-6a48c6e07247 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.700627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.737832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.739602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.739888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.740184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.785486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.813822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b79b7-1c57-4c7b-9fa6-0e44e739cdc8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:22.828185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.829678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.857930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:22.858550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:22.858835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:22.859113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:22.860304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:22.861769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:22.861920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:22.864485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:22.865255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:22.958734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 44/89] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:22.958734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.005420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ee18-eb6b-4757-b286-20b0737a994f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.042925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.043465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.043748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.044063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.045215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.046748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.048480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:23.049252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.063106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:23.091346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033edebe-059a-49f6-946d-2b0dad5a96ee None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.121888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:23.132077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.132707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.132992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.133266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.134097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=3938cf1c8bd54a1e841528f9f40a833f) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:23.134411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.136044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.144723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 45/91] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:22 2022] GET /identity/v3/role_assignments?user.id=3938cf1c8bd54a1e841528f9f40a833f&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:23.145374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.177364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9bb9-81fc-4cef-8ecb-53d28b9d29c8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.225612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.226456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.227799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.232509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.233613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:23.233911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.238730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.249996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 47/92] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:23 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=b086728fbde044b28647906c294e9a64 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:23.250876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.358414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f06a1-02b2-4645-a17c-1628fd7050a7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.414500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.415510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.416017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.417208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.418820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.420887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.423495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:23 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:23.429875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.478738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:23.498864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:23.544043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c99bf-7683-4027-b73a-efa8814f9646 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.549924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28070761-7db0-4f0f-89bb-a0ff99434875 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:23.580255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.582269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.582757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.583224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.584178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:23.584687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.586337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.592458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 47/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:23 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7cd14d5c176345a398d14136efaa152f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:23.618006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:23.619020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:23.619503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:23.620117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:23.716541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:23.718924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:23.810120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:23.844176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 48/95] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:23.851366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:23.986417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c185-57d8-4d48-95df-37c407b834c8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:24.013361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:24.029176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:24.029922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:24.030208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:24.030482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] PATH_INFO: `/v3/projects/a8a32bc9fefd494db3933c8c7276b9db` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:24.031622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a32bc9fefd494db3933c8c7276b9db)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:24.033138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37450b-8f90-4b2b-b2a1-fff056c29e62 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:24.035438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:23 2022] GET /identity/v3/projects/a8a32bc9fefd494db3933c8c7276b9db => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:24.041258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:24.166279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f09802-151d-4e66-8a15-1c4da05c35fd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:24.208280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:24.208899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:24.209182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:24.209458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:24.210274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=a8a32bc9fefd494db3933c8c7276b9db, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:24.210589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:24.212034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f2ae-1fbe-4e47-bc8f-d32192cad806 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:24.220105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:24 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=a8a32bc9fefd494db3933c8c7276b9db&role.id=b086728fbde044b28647906c294e9a64 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:25.672789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916616-7327-4a11-b6a6-782a836d467d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:25.673319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916616-7327-4a11-b6a6-782a836d467d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:25.673319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef916616-7327-4a11-b6a6-782a836d467d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:25.674910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:25.685839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c88e-bd0c-4056-824f-277450502f0a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:25.686317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c88e-bd0c-4056-824f-277450502f0a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:25.686393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c88e-bd0c-4056-824f-277450502f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:25.711170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-efb9c88e-bd0c-4056-824f-277450502f0a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:25.712388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-efb9c88e-bd0c-4056-824f-277450502f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:25.758768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:25.806728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:26.133698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18019-dda7-40c5-891b-fc89eaa13dd4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.134064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18019-dda7-40c5-891b-fc89eaa13dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.134255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18019-dda7-40c5-891b-fc89eaa13dd4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.135602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 50/100] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:26.140730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.141019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.141295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.154702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed816bb8-caa3-4856-9234-85ef0e979d9c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.155210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed816bb8-caa3-4856-9234-85ef0e979d9c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.155712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed816bb8-caa3-4856-9234-85ef0e979d9c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.158420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 51/101] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:26.167735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.168038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.168318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.197288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:26.198479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:26.204659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:26.210566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:26.325366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:26.326684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:26.335968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 07:50:26.478747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:26.485018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3b0a-a0e6-458f-8eb1-ed73bf2ff9f8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:26.538005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:26.538863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.539222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.539837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.541022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:26.542496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37a6c-2aec-47da-9d3c-ddeebbf4362a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:26.544268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 52/104] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:26.550830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:26.656984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c035-7837-4f81-8958-60b4ab9958c7 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.657292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c035-7837-4f81-8958-60b4ab9958c7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.657552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c035-7837-4f81-8958-60b4ab9958c7 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.660867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 53/105] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:26.665257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.665547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.665827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.693498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:26.694719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:26.712095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39a94-cb22-41d3-900c-b72dec38f737 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:26.750149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:26.766945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:26.767570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:26.767855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:26.768178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:26.769371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:26.770886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:26.807324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 54/106] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:26.808522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:26.859053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 53/107] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:50:26 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:26.865467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:26.964342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:26.971708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53065-1151-4a63-ad23-2e854bc0cb63 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.063689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.068720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.069013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.069743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.087401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:27.092434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73e2a-3d59-4dce-9dae-a690262d094d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:27.094618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:27.095455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:27.096281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 55/108] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:27.102102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.147297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.148684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.149747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.150416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.169789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:27.177630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:27.178588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:27.179350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 54/109] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:27.180005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.232553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.238479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd1923-a7cc-443a-ac1f-ff7672336c03 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.286420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.287632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.288015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.288562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.289102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:27.289564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.290961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.303561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 56/110] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:27.303561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.321926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24329158-9a26-44ab-8935-db1b081c724f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.329444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.373313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.373958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.374239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.374543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.388137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9bbf7270-7456-4741-b14b-deb5226cdecb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:27.393100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:27.394044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:27.395225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 55/111] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:27.396002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6603b-a84d-4231-a41d-0ebe815ee820 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.400655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6603b-a84d-4231-a41d-0ebe815ee820 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.400978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6603b-a84d-4231-a41d-0ebe815ee820 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.403066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 56/112] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:27.404096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6603b-a84d-4231-a41d-0ebe815ee820 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.439713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d916d8-e067-41f1-9324-52b6ac473107 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.486947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.488388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.488679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.489123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.489803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:27.490110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.491682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.502842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 57/113] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:27.503788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.523026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.531973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6603b-a84d-4231-a41d-0ebe815ee820 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.573007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.573571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.573859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.574138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] PATH_INFO: `/v3/users/d502527782cf4c79b13e0e1e65012a09` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.589691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] RBAC: Authorizing `identity:get_user(user_id=d502527782cf4c79b13e0e1e65012a09)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.591141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123115f0-4fc8-4fcc-86ac-ec0f60495830 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.592998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 57/114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/users/d502527782cf4c79b13e0e1e65012a09 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:27.593972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a40-97e1-44bf-803c-2e792eb178f4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.594254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a40-97e1-44bf-803c-2e792eb178f4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.594526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27452a40-97e1-44bf-803c-2e792eb178f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.608249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.614681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-27452a40-97e1-44bf-803c-2e792eb178f4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:27.615899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-27452a40-97e1-44bf-803c-2e792eb178f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:27.627199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9315f-504d-4e88-90cc-c5a7ae39d4b6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.665939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.666683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.666968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.667247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.667925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:27.668266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.669654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.679589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 58/115] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:27.680350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.693387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:27.694541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22761e-77a0-46da-a2e9-5dd5cb2fee83 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.694829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22761e-77a0-46da-a2e9-5dd5cb2fee83 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.695103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22761e-77a0-46da-a2e9-5dd5cb2fee83 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.696493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 59/117] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:27.700968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22761e-77a0-46da-a2e9-5dd5cb2fee83 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.797727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.801506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e383-c391-437c-a717-6cff7107ca72 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.820802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22761e-77a0-46da-a2e9-5dd5cb2fee83 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:27.839136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.840245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.840701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.841132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.842541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.844295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.846131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 59/118] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:27.851939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:27.865349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:27.866598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:27.867586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:27.868314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:27.868705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:27.950178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:27.951820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:27.971072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7beab-a059-4164-af22-5bc7211719dd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.007301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.007940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.008259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.008538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.009677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.011128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3531a-c9b9-4672-b71a-129d2866425d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.012744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 60/119] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:28.013998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.014296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.014575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.032099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:28.033296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:28.038813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.058149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 60/120] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:28.059414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.115882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:28.120971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.142021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.189979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b9a1-9803-4f13-9dcc-85947c9a977f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.230610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.231259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.231539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.231885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.233317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.234514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.236375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 61/122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:28.237986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.254446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582026a-a7f3-4a85-83a5-70515034cac4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.299215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.300793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.301147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.301714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.302198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.313720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:28.319728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:28.320609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:28.321368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:28.323654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 62/123] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:28.325775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.351050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937eaf-5b55-454e-a049-131dd328913d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.393253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.395352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.395927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.396444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.397831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.399594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.401695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 62/124] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:28.403448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.419482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.456722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c31a-784e-4cbf-812b-2237816639d1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.497687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.498319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.498598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.498869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.500019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.501476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.508833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 63/125] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:28.508833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.527511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27898c-c231-4ba7-ae0c-c8cd1436275c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.546012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.563567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.564442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.564858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.565264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/users/3938cf1c8bd54a1e841528f9f40a833f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.568725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, user_id=3938cf1c8bd54a1e841528f9f40a833f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.570380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.609952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4e4a1-3e5e-4603-86e0-d64023b1862d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.643764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.644318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.644646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.645053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.645723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:28.646032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.647410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.649571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.655822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:28.656631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.669062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 63/127] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:28 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/users/3938cf1c8bd54a1e841528f9f40a833f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:28.670108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.785269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ad9e-f4fa-4f12-9379-17f1de032ef2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.807716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694da1f-7793-43a2-923b-eac3d668d0f9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:28.833054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.834436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.835602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.836134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/users/584742ad64ff4f9cb9eb105d29a34654/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.839444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, user_id=584742ad64ff4f9cb9eb105d29a34654, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:28.841700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:28.852805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:28.852805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:28.853081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:28.853416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:28.866238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:28.871209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:28.872279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 64/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:28.873234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:28.922825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:28.951496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 65/129] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:28 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/users/584742ad64ff4f9cb9eb105d29a34654/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:28.952938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.007937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ef5a-8abd-41bf-9ffa-78f8cfc0d9a3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.034229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:29.088302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334270c-b7e8-4471-907c-29d6a408511e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.092803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.093429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.093712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.093984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.094720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=d502527782cf4c79b13e0e1e65012a09) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:29.095026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.096574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.118716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 65/130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/role_assignments?user.id=d502527782cf4c79b13e0e1e65012a09&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:29.119367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.145947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.147724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.148306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.148770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.150416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.152393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.155070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 66/131] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:28 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:29.161907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.335024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118117-85e4-4739-bd35-be2ef92f5b9d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.383952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c278a-d6eb-466d-8316-65a17409064b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.386700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:29.417675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:29.435576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.436519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.436801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.437076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.439452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.441560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.444414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 67/132] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:29 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:29.455802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.472933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.473655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.473937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.474206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.474875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:29.475173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.476587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.502452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 66/133] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:29.508510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.688162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536545-42bc-4f5f-80b7-211d1485363a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.725885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd51f-c949-4da7-8243-4eedc0a14ca2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:29.738212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.738894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.739178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.739453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/users/584742ad64ff4f9cb9eb105d29a34654/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.741692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, user_id=584742ad64ff4f9cb9eb105d29a34654, role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.743158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08c8a3-3b97-43c3-b7f2-926e3c248c3b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.773863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:29.774546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.774831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.775218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.776885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:29.778380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858dcc4-aba9-4078-89d1-7712a068ba46 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:29.780510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 67/134] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:29 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:29.781994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dd07-4568-4477-bc3e-97bf71f9a849 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.782289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dd07-4568-4477-bc3e-97bf71f9a849 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.782566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dd07-4568-4477-bc3e-97bf71f9a849 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.784081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 68/135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:29.789040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447dd07-4568-4477-bc3e-97bf71f9a849 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:29.829562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:29 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/users/584742ad64ff4f9cb9eb105d29a34654/roles/7cd14d5c176345a398d14136efaa152f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:29.830679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:29.831021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:29.836515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:29.844375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:29.885067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:29.886315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:29.977809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447dd07-4568-4477-bc3e-97bf71f9a849 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:30.000350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:30.028619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 69/137] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:30.069465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:30.070377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:30.070799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:30.071211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] PATH_INFO: `/v3/projects/a8a32bc9fefd494db3933c8c7276b9db` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:30.072508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a32bc9fefd494db3933c8c7276b9db)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:30.080000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:30.082561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 69/138] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:29 2022] GET /identity/v3/projects/a8a32bc9fefd494db3933c8c7276b9db => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:30.088589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:30.255258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bb267-2dda-40cf-906b-cc338841d0f2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:30.311684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:30.312398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:30.312685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:30.312981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] PATH_INFO: `/v3/projects/a8a32bc9fefd494db3933c8c7276b9db/users/584742ad64ff4f9cb9eb105d29a34654/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:30.321252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8a32bc9fefd494db3933c8c7276b9db, user_id=584742ad64ff4f9cb9eb105d29a34654, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:30.322730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:30.425888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 70/139] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:30 2022] PUT /identity/v3/projects/a8a32bc9fefd494db3933c8c7276b9db/users/584742ad64ff4f9cb9eb105d29a34654/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:30.597610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:30.731918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:30.734741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb4f3-0937-474d-a37b-74fb4661f5f8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:30.780035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:30.785816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:30.785816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:30.785816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:30.785816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:30.785816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33625-6d50-4b00-a46f-0ffa0776586c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:30.786152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 70/140] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:30.793241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:30.872657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:30.954917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec09cf5-57ea-4cec-ae83-1a9c3806c689 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:31.010017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:31.011058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:31.011559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:31.011875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:31.012577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:31.014779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e546-0b04-4162-b014-c58e57dd659e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:31.154590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 71/141] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:30 2022] POST /identity/v3/users => generated 283 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:31.750151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a26e7f-8369-4fae-b221-9bea6b6fd6e2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:31.751176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a26e7f-8369-4fae-b221-9bea6b6fd6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:31.751658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a26e7f-8369-4fae-b221-9bea6b6fd6e2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:31.753298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 71/142] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:31.767098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e22c8-9ac3-449f-a267-c4564256f205 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:31.767386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e22c8-9ac3-449f-a267-c4564256f205 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:31.767664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e22c8-9ac3-449f-a267-c4564256f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:31.789003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1a3e22c8-9ac3-449f-a267-c4564256f205 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:31.790495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1a3e22c8-9ac3-449f-a267-c4564256f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:31.883701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 72/143] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:32.202990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad45b2-5b12-4779-84e8-6d67252b5928 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.203640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad45b2-5b12-4779-84e8-6d67252b5928 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.204150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad45b2-5b12-4779-84e8-6d67252b5928 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.205697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 72/144] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:32.211529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3dee2-205b-421b-bd8c-014c28db3567 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.211814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3dee2-205b-421b-bd8c-014c28db3567 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.212116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3dee2-205b-421b-bd8c-014c28db3567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.234943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-64e3dee2-205b-421b-bd8c-014c28db3567 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:32.241361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64e3dee2-205b-421b-bd8c-014c28db3567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:32.273694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad45b2-5b12-4779-84e8-6d67252b5928 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:32.288939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:32.344459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 73/145] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:32.346014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba918-4537-413a-81fb-fae02d95ad84 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.346304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba918-4537-413a-81fb-fae02d95ad84 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.346584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba918-4537-413a-81fb-fae02d95ad84 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.349509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 74/146] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:32.354962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.355247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.355524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.375170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:32.376430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:32.399621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad45b2-5b12-4779-84e8-6d67252b5928 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:32.444401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:32.445455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.445958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.446468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.458966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:32.461211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 75/147] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:32.465340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:32.466180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:32.466933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:32.475414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:32.475689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 73/148] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:32.576135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:32.586939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d515a-9b3b-4ed3-8c04-249ea6c8a535 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:32.623135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:32.624097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.624550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.624994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.625836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:32.626310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:32.628514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:32.638267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 76/149] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:32.644265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:32.677531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:32.761264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b783-e847-40a4-bcbe-0c778f00d73c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:32.802724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:32.803373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:32.803657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:32.803936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] PATH_INFO: `/v3/users/3938cf1c8bd54a1e841528f9f40a833f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:32.808495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] RBAC: Authorizing `identity:get_user(user_id=3938cf1c8bd54a1e841528f9f40a833f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:32.810135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:32.811887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 74/150] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:32 2022] GET /identity/v3/users/3938cf1c8bd54a1e841528f9f40a833f => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:32.817326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:32.851766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:32.993556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c093c-523d-405d-b517-1d7f38359f70 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:32.996543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e59be4-6ff3-43aa-8360-d25d50e107aa None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.008344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.037395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.038105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.038390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.038643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.050443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:33.055466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:33.055602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:33.056449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:33.057205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:33.057781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.057781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.057781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.057950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 75/151] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:33.057950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.100838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.166897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31288-eee1-4c84-8e45-d272eddd6e85 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.192558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:33.194038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:33.207734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.208406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.208685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.208960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.237404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:33.242547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:33.243561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:33.244458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:33.249150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 76/152] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:33.249798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.295722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.373387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 77/153] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:33.374082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.489610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e32b-569c-4844-8e00-bb1d2aa46d01 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.520562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.582726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.583246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.583522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.583790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.584480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:33.584783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:33.586629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:33.603173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 77/154] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:33.604220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.614095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a096e-cf4f-411c-898d-e123556eaf27 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.689660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.690280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.690799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.691058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.691943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:33.692281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:33.693691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:33.705864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 78/155] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:33.707715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.759093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.784433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fbc95-6435-457b-a543-5784288dac58 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.814775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4a39-da84-4dee-9465-967ae72bd1d8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.832557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:33.840914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.841547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.841871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.842209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.843348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:33.844917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a261-ab6e-4dd5-b590-bd301c50453a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:33.847342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 78/156] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:33.848654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471821-7ada-415c-b788-d7e5a1e77619 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.848932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471821-7ada-415c-b788-d7e5a1e77619 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.849205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471821-7ada-415c-b788-d7e5a1e77619 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.850869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:33.851000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 79/157] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:33.851664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471821-7ada-415c-b788-d7e5a1e77619 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.854989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:33.855282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:33.855570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:33.857790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:33.860127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:33.860903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 79/158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:33.862028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:33.968628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471821-7ada-415c-b788-d7e5a1e77619 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:33.972477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabd911-d422-4f20-bcbc-09bd0a8d6a35 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.006082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.006778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.007058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.007332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] PATH_INFO: `/v3/users/d502527782cf4c79b13e0e1e65012a09` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.008621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=d502527782cf4c79b13e0e1e65012a09)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:34.010053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779148b-8d90-4c81-9c4b-6067feb53eb4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:34.011748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 80/159] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/users/d502527782cf4c79b13e0e1e65012a09 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:34.013063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.013444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.013719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.021906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.022551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.022813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.023091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.023843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=3938cf1c8bd54a1e841528f9f40a833f) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:34.024271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:34.025651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:34.033436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:34.035308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:34.040157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 80/160] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:33 2022] GET /identity/v3/role_assignments?user.id=3938cf1c8bd54a1e841528f9f40a833f&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:34.041331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:34.047830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:34.119641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 81/161] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:34.120251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:34.150031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:34.237115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dce1cd-4398-4d10-97e3-ff2957d71c61 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.279062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007427-a185-470e-93ed-21e4d3cd693a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.290731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.291688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.292219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.292675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.294122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:34.295891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:34.297779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 82/162] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:34 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:34.303968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:34.326643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:34.360996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.361638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.361926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.362207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.431063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732f21-b5a9-4186-ae92-6b3ae2a7f2b1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.468217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.468897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.469235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.469620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/users/d502527782cf4c79b13e0e1e65012a09/roles/7c5113bc949c4a0885dcff8e0b4c8a54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.471588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, user_id=d502527782cf4c79b13e0e1e65012a09, role_id=7c5113bc949c4a0885dcff8e0b4c8a54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:34.475082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075203-ae0d-48eb-9210-0e8f751ec2f3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:34.476338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:34.477815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:34.543348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:34.557824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 83/163] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:34 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/users/d502527782cf4c79b13e0e1e65012a09/roles/7c5113bc949c4a0885dcff8e0b4c8a54 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:34.561161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0d43-6bcb-4f67-b188-94e1366180d4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.561716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0d43-6bcb-4f67-b188-94e1366180d4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.562215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0d43-6bcb-4f67-b188-94e1366180d4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.563908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 84/164] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:34.570345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.571159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.571632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.603024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:34.604843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:34.639257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 81/165] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:34.662878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:34.714703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 85/166] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:34.715946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:34.719754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:34.882069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec5576-42aa-422a-a651-a6a485a9ed56 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.921806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34cd4-6ed5-4a6f-819a-454202671a97 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:34.944043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:34.944769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:34.945056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:34.945329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:34.969719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:34.975008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:34.976042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:34.977021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 86/167] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:34.986148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.008993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.009651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.009932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.010210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.011344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:35.012829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:35.014487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 82/168] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:34 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:35.025031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.048968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:35.166584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:35.187352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956289c-b0d4-4498-bdcb-08677fbb5f07 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.232574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0ea40-070f-4a3a-a5da-e19adacd78d2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.244299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.246199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.247171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.247597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.248667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:35.249142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:35.251430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:35.260905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 83/169] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=b086728fbde044b28647906c294e9a64 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:35.261927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.291358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.292004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.292283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.292561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.293233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:35.293536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:35.294982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:35.326519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 87/170] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:35.331063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.452663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:35.495166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5f313-5c66-4a5b-b353-87af46c1e5ff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.541319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe658-6543-4c56-9fd1-fb63d1c926d4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.546764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.547648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.548164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.548641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.561418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:35.568337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:35.569259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:35.570051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:35.573384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 84/171] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:35.579618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.595442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:35.620832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.621630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.621918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.622354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.623619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:35.625188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:35.626799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 88/172] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:35.633669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.757639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ab136-21f0-4287-b337-7a2ed3b0c5eb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.802878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.803851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.804356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.804832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.805713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:35.806243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:35.810746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:35.817936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:35.825465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 85/173] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:35.829807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:35.841352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07a7a-ffc0-4df0-8750-520e26b65ec6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:35.934541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:35.935175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:35.935441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:35.935784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:35.997932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43178e0e-495c-49f2-8455-262d01dcd854 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:36.051249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.053234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.069389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.083464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:36.084145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.084368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.084642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] PATH_INFO: `/v3/users/584742ad64ff4f9cb9eb105d29a34654` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.085782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=584742ad64ff4f9cb9eb105d29a34654)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.087224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83766b-a381-4aa4-b975-91048a78a1f7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.088991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 86/174] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/users/584742ad64ff4f9cb9eb105d29a34654 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:36.089938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35462-eb61-496a-9d03-bdf9a82bd3da None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.090216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35462-eb61-496a-9d03-bdf9a82bd3da None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.090487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35462-eb61-496a-9d03-bdf9a82bd3da None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.095621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 87/175] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:36.098344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.098639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.099031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.117718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:36.119019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:36.190074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 89/176] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:36.191661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.218574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.234652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 88/177] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:36.235531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.320160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.335096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e655aea-1ddd-4cce-8777-92458a1d465f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:36.388204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:36.388881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.389164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.389444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.402041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a03b1-8005-4caa-9487-ff914c59e756 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:36.480543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.482149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.507096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:36.508148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.508645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.509129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.510459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.520299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.522633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 89/178] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:36.528130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.608676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.628613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 90/179] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:36.634205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.664346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.734028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea58b6-c0c5-46f1-adce-03c160fa674d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:36.803405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:36.804632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.806271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.807512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.808506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:36.810673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.812372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.822576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 90/180] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7cd14d5c176345a398d14136efaa152f => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:36.823771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.830521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637e6e-6454-4b31-9603-a5d248e64de9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:36.870065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:36.870763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.871042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.871315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] PATH_INFO: `/v3/projects/a8a32bc9fefd494db3933c8c7276b9db` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.872551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a32bc9fefd494db3933c8c7276b9db)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:36.874042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8bdb5-db4d-411c-a7f0-a5df6ae31444 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:36.876211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 91/181] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/projects/a8a32bc9fefd494db3933c8c7276b9db => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:36.877239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4de9d-2c9d-4824-a8dd-dcc372bf88a4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.877518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4de9d-2c9d-4824-a8dd-dcc372bf88a4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.877786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4de9d-2c9d-4824-a8dd-dcc372bf88a4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.879526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 92/182] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:36.887704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cafac-5194-43c0-ac93-08e9359fcf5c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:36.887704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cafac-5194-43c0-ac93-08e9359fcf5c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:36.887704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cafac-5194-43c0-ac93-08e9359fcf5c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:36.887704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 93/183] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:36.887704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cafac-5194-43c0-ac93-08e9359fcf5c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:36.955861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:36.986072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45fb5-593e-4d79-8f0a-0c3362503888 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.010010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cafac-5194-43c0-ac93-08e9359fcf5c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.021004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.027846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.028476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.028887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.029265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.042280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bb0dbbca-b3f9-47e2-a292-c27c9a6c70ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:37.047169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:37.048300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:37.049311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 91/184] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:37.050947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.050947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.050947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.057346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.058178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.058659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.058972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.059669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=a8a32bc9fefd494db3933c8c7276b9db, user.id=584742ad64ff4f9cb9eb105d29a34654) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:37.059997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:37.061988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a808c16-0984-4c80-97d7-9477b09196f9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:37.072040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 94/185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:36 2022] GET /identity/v3/role_assignments?user.id=584742ad64ff4f9cb9eb105d29a34654&scope.project.id=a8a32bc9fefd494db3933c8c7276b9db&role.id=b086728fbde044b28647906c294e9a64 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:37.073547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.074103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.074580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.079705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:37.081588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:37.099802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:37.101107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:37.169426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 92/186] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:37.170973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.189719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 95/187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:37.294311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719aa8-943e-494e-82ca-2c447db97724 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.328042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.344194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:37.349248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:37.361755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 93/188] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:37.368623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.448061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.497331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37d708-baec-4d08-8e8a-a1f268f05fd7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.518150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.537515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.538169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.538448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.538722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.562137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:37.563614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:37.566212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 96/189] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:37.571675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.640155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb57d3e-6d98-4489-b02c-5074de60c45a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.677380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.678046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.678329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.678612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.689106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:37.689405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d7117-3cad-43bf-bb34-f331ca8ad12e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:37.694031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:37.694916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:37.695754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 94/190] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:37.700452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.706158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.728122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.728744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.729025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.729300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.747398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.806541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:37.808053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:37.812864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f282877-4833-4d59-930c-225806e69a4e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.859913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:37.860577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:37.860858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:37.861133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:37.862394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:37.864952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:37.866539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 95/191] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:37.868147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.933952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 97/192] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:37.933952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:37.943732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:37.975518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc923c-0660-4903-9e0c-fb7f1c9c87c0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:37.986021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.008467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.009075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.009358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.009629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.010282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:38.010581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.011960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3343af-bb3a-4c46-a8b4-8bd311ff1fd1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.020079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 96/193] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:38.021238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945236-f845-4a2b-b4e1-712c58f1e660 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.021506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945236-f845-4a2b-b4e1-712c58f1e660 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.021774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945236-f845-4a2b-b4e1-712c58f1e660 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.022979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 97/194] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:38.023663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a945236-f845-4a2b-b4e1-712c58f1e660 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.029828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c35b2-a6eb-4d62-bf1f-f335a28cbb75 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.063565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.064199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.064474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.064745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.065516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.066982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd27932-0f1e-4353-9e44-62f89fd25387 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.128824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a945236-f845-4a2b-b4e1-712c58f1e660 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.161500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.162378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.162654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.162924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.164042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.165490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.167135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 98/195] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:38.167883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.184015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 98/196] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:37 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:38.184015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.184015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.184015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.197720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:38.198985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:38.217845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.283381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.289997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 99/197] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:38.291115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.304919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270804c-5ef4-4056-8849-69311b63dc12 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.344477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.345724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.345724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.345724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.347523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.349325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.356684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 99/198] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:38.356866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.438501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789252e-83a4-454b-a7d2-8d67ad0951e5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.483944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.484928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.485375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.485833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.486896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=86f446d052c4496e94ef167478434b54) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:38.487830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.489815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.496242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 100/199] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/role_assignments?user.id=86f446d052c4496e94ef167478434b54&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:38.497497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f551085-598e-4ba9-b3dc-4e0250ac61b9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.510319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.546577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.547816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.548131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.548410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.579060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.640230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:38.642144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:38.657085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.717307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606a05-2754-41f5-8d58-3a693ab9a786 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.779089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 100/200] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 07:50:38.785726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.788723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:38.790101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:38.790101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:38.790101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:38.802271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:38.803764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:38.808636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:38.809525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:38.810317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:38.812991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 101/201] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:38.823576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:38.952334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053bfd2-adef-42fe-b73c-0ba8a9cea7ca None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:38.986104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a5ca-4cae-4db5-afd3-40e8007a7557 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.001156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:39.023792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.024436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.024716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.024986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.025650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:39.025987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.029536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.037086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.037732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.038011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.038285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.039789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.040921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.042727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 101/202] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:39.048644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:39.050147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 102/203] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:39.055900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:39.192835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:39.224628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ad916-5133-4717-aa1f-0601550ece63 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.237012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64696ed6-4508-43ec-933d-1356a3474330 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.292554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.293206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.293489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.293763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] PATH_INFO: `/v3/users/d502527782cf4c79b13e0e1e65012a09` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.295739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] RBAC: Authorizing `identity:get_user(user_id=d502527782cf4c79b13e0e1e65012a09)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.297208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.298802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 103/204] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:39 2022] GET /identity/v3/users/d502527782cf4c79b13e0e1e65012a09 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:39.306073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:39.306983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.307608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.307888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.308185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.308924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=86f446d052c4496e94ef167478434b54) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:39.309237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.310683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.319863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 102/205] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:39 2022] GET /identity/v3/role_assignments?user.id=86f446d052c4496e94ef167478434b54&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7cd14d5c176345a398d14136efaa152f => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:39.376416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:39.423073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbf1a-4334-43a7-b1fb-08f6a648b74c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.460486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.461113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.461398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.461674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.540230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.541767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.599469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:39.649846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 104/206] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:39.655522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:39.774767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092098e-bf52-496a-8a00-c40e4b7047ff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.821565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.822207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.822482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:39.822756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:39.823867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:39.825338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207104a9-8998-4cc4-a9a1-130a491c4c0f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:39.828003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 103/207] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:39 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:39.833639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:39.962900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76d79-e503-48b3-9210-4b8c3fa0b573 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:39.998886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:39.999506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:39.999788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:40.000088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:40.000822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, scope.project.id=d7b44966f1844db59dec086347156e67, user.id=d502527782cf4c79b13e0e1e65012a09) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:40.001127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:40.002577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eb2f6-8465-4231-b0ef-4ac19560e66d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:40.009681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 105/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:39 2022] GET /identity/v3/role_assignments?user.id=d502527782cf4c79b13e0e1e65012a09&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:40.994767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2654-f73f-482e-83e9-b9bcfb9227f6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:40.995280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2654-f73f-482e-83e9-b9bcfb9227f6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:40.995353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2654-f73f-482e-83e9-b9bcfb9227f6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:40.996959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 104/209] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:41.002568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679343-3f65-4ec6-a1a0-09fbd17587b8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.003101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679343-3f65-4ec6-a1a0-09fbd17587b8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.003173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3679343-3f65-4ec6-a1a0-09fbd17587b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.007377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a163-31ae-4dde-b40a-1cd816d4fef0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.007667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a163-31ae-4dde-b40a-1cd816d4fef0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.008041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a163-31ae-4dde-b40a-1cd816d4fef0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.009546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 105/210] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:41.015939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.016253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.016532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.025073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d3679343-3f65-4ec6-a1a0-09fbd17587b8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:41.026521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d3679343-3f65-4ec6-a1a0-09fbd17587b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:41.038304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.038645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:41.040326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:41.043344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.106076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 106/211] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:41.107511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92726-4692-41bb-9f2e-e7e72533aac9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.107869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92726-4692-41bb-9f2e-e7e72533aac9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.108243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92726-4692-41bb-9f2e-e7e72533aac9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.109708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 107/212] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:41.115156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.115441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.115723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.132525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 106/213] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:41.134352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:41.135750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:41.207089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 108/214] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:41.401071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.423964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.519625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.538970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afcc5a-cdd9-4d83-98e7-336aab9dccc9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:41.545742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08364f-bc72-4def-8baa-62d746c39363 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:41.564428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:41.565066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.565454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.566016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.566821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:41.568289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:41.570012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 107/215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:41.574942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.584169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:41.584395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.584819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.585227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.585402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.595931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:41.601453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:41.602343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 109/216] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:41.604910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.684620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f7f6c-544b-4c23-8308-89980df7c9fd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:41.713739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ff31-0464-416f-b40c-af0fea1c88b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:41.720192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:41.720830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.721110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.721530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.732278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:41.739239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:41.740179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:41.741049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 108/217] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:41.741700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.755937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:41.756671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.756948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.757217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.758023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:41.759838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:41.769914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.811874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:41.850316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324430c7-7f96-4998-af7e-011969be10b4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:41.869359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 110/218] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:41 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:41.870264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:41.899202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:41.899839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:41.900155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:41.900432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:41.901115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:41.903202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:41.903202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:41.912942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 109/219] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:41.921965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.008204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731367c3-2d7e-4b72-a8e6-c9877e2178f4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.037302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7ac5-0885-4afd-98b3-28951b155450 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.051993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.053020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.053500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.054714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.055160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:42.055468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.056912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f25da-4d40-4484-b128-b5ba3fca315a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.066916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:42.068175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71032bea-c73e-4f04-8332-8310c3090bb3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.068464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71032bea-c73e-4f04-8332-8310c3090bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.068761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71032bea-c73e-4f04-8332-8310c3090bb3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.070068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 112/221] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:42.072494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.072832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71032bea-c73e-4f04-8332-8310c3090bb3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.082580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.086019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.086019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.086019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.086019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.086528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bc1c8-e552-4140-aea1-dc20aa40464e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.088463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 110/222] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:41 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:42.089623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.089957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.090186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.108994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:42.110186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:42.148264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.202468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 111/223] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:42.203693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.213439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71032bea-c73e-4f04-8332-8310c3090bb3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.248430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.249059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.249335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.249602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] PATH_INFO: `/v3/users/b2d3c8c683094c739b2def732361a8bd` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.269524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] RBAC: Authorizing `identity:get_user(user_id=b2d3c8c683094c739b2def732361a8bd)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.275833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.277602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 113/224] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/users/b2d3c8c683094c739b2def732361a8bd => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:42.283860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.326130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ceb8-1bb8-4821-a078-4b8acbf10d75 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.360337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.366575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.367237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.367525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.367812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.369177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.370778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.372727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:42.378696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.394925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361770-8845-45b4-8cf3-7e05badd1660 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.413070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.435640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.436417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.436747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.437020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.541607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60616075-3b33-459a-bfe7-d26192a120fb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.556781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.558685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.583195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.584122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.584568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.584986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/users/86f446d052c4496e94ef167478434b54/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.587363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, user_id=86f446d052c4496e94ef167478434b54, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.589162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.669943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 114/226] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:42.670860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.676964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 113/227] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:42 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/users/86f446d052c4496e94ef167478434b54/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:42.678063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.688202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.789642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:42.834541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab131-2cca-44d6-978b-14e3b2e8e040 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.877007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.879292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.879820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.880330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.884106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f264ec-63f5-4d47-88d8-a6d88d3f4c1c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:42.893486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:42.899720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:42.900627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:42.901418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:42.904025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:42.911648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:42.936509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:42.937151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:42.937435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:42.937713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:42.938927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:42.942077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:42.944556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:42.950216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:43.050714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:43.106147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a6b2-9fbc-48bc-972d-db0868da3b3e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:43.116492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e269-9ac3-4cbf-af6f-c524cf907f3b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:43.143085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:43.166862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:43.167487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:43.167768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:43.168064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:43.168998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=b2d3c8c683094c739b2def732361a8bd) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:43.169315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:43.171711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:43.180377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:43.180995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:43.181285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:43.181561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:43.182235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:43.182540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:43.183922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:43.187145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 115/230] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/role_assignments?user.id=b2d3c8c683094c739b2def732361a8bd&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=b086728fbde044b28647906c294e9a64 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:43.202238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 116/231] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:43.208212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:43.363482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b2f5-bc64-4f62-b33a-2c3333b96ff2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:43.402276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:43.402926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:43.403210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:43.403489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:43.408859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:43.410448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:43.412537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 116/232] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:43 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:43.418088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:43.543515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500b27-8d03-4ba6-a951-7409ac88333f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:43.583495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:43.584162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:43.584442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:43.584715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:43.585851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:43.587294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93918a8c-cd51-40bb-be5c-a34cb6ea4bda None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:43.589289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 117/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:43 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:43.594591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:43.687630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:43.735195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ab83-eb5a-4a3a-8093-13eae63ab5ec None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:43.772297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:43.773338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:43.773830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:43.774304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/users/86f446d052c4496e94ef167478434b54/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:43.776723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, user_id=86f446d052c4496e94ef167478434b54, role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:43.778397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533b415-6b39-40a9-97c2-b98e01ca38e8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:43.887286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 117/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:43 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/users/86f446d052c4496e94ef167478434b54/roles/7cd14d5c176345a398d14136efaa152f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:44.585720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a234b2-a2d7-4fd2-a35d-f5e003ef3185 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:44.586737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a234b2-a2d7-4fd2-a35d-f5e003ef3185 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:44.587215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a234b2-a2d7-4fd2-a35d-f5e003ef3185 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:44.589051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 118/235] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:44.605847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e2e-4a46-4f8c-b6a4-13e6451aed32 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:44.606739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e2e-4a46-4f8c-b6a4-13e6451aed32 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:44.607206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e2e-4a46-4f8c-b6a4-13e6451aed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:44.634044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f94e1e2e-4a46-4f8c-b6a4-13e6451aed32 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:44.635646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f94e1e2e-4a46-4f8c-b6a4-13e6451aed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:44.728499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 118/236] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:44.828231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545b93-f54c-42b7-9350-b69b7fe77ead None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:44.828858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545b93-f54c-42b7-9350-b69b7fe77ead None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:44.829330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a545b93-f54c-42b7-9350-b69b7fe77ead None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:44.831697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 119/237] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:44.837231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:44.837468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:44.837749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:44.860080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:44.861267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:44.919194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:44.956331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:45.193508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a545b93-f54c-42b7-9350-b69b7fe77ead None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.196540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:45.267344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.364806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a545b93-f54c-42b7-9350-b69b7fe77ead None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:45.381963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180888-1381-4086-9463-81227f3f8e5d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:45.429661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:45.430295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.430627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.430904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.448466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:45.454629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:45.455492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:45.456378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 120/239] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:45.458676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:45.458871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.459878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.459878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.460484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:45.462011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:45.463567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:45.464483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.470296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.560383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:45.587491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:45.627727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ceb62-2844-4dc8-97f3-f0b914906013 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:45.663306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:45.663940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.664251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.664523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.665203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:45.665505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:45.666921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:45.677068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 121/241] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:45.683354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.694335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587b885-e5da-4ed6-9228-ecce56b01b2d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:45.737154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:45.738148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.738699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.738973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.739628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:45.741830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ca5a1-f56b-4541-a2b5-768e417d9de1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:45.799453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8dc85-83bc-4c61-a774-58aa60efae10 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:45.808190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 121/242] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:45 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:45.809554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960f5-2fc5-4974-a3c3-b79f01e26b10 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.809938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960f5-2fc5-4974-a3c3-b79f01e26b10 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.810215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae960f5-2fc5-4974-a3c3-b79f01e26b10 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.815656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 122/243] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:45.815656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cacd-ae82-457e-8352-2f6f5fdba5f5 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.815656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cacd-ae82-457e-8352-2f6f5fdba5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.815656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cacd-ae82-457e-8352-2f6f5fdba5f5 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.815656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 123/244] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:45.820151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.820444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.820774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.835461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:45.846001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:45.848193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:45.848332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:45.849197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.849751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.850379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] PATH_INFO: `/v3/users/829da7c330a74d17ad277d8e5064be9e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.868399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] RBAC: Authorizing `identity:get_user(user_id=829da7c330a74d17ad277d8e5064be9e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:45.870441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af83d33-8050-41f0-9b53-2dbb368482b0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:45.873223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 122/245] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:45 2022] GET /identity/v3/users/829da7c330a74d17ad277d8e5064be9e => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:45.874943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:45.875551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:45.876098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:45.897236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:45.899095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:45.947511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 124/246] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:45.952383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:45.984379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:46.014570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 123/247] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:46.079420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079b56-ee80-4c6e-be21-1500b5d9dded None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.117641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.118528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.118953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.119370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.208498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:46.210290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:46.241867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:46.269477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.353531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 125/248] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:46.361065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.400884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a401ec-9171-41ce-9c30-01f36e78e206 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.419344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:46.444494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.445103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.445379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.445645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.462627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:46.467529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:46.468536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:50:46.469323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:46.469913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 124/249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:46.474966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.516396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663aaa4-a0c8-498f-8400-8c4029844f9c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.559055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:46.577484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.578461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.584717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.585221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.586684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:46.588470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:46.590329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 126/250] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:46.594064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.623044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7018e-13ef-47c3-bec6-ea5043adff1d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.669120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.670710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.671138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.671704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.693143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:46.698498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:46.699569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:46.700475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:46.706399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 125/251] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:46.706399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.758602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:46.798575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8145-fd5a-40b3-b722-9132798c19f9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.848605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85938-5de2-4739-a9d1-f89dce6cedc1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:46.856165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.857076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.857651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.858139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.859009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:46.859611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:46.861459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:46.872692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 127/252] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:46.873467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.892690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:46.893389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.893807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.894095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.895037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=829da7c330a74d17ad277d8e5064be9e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:46.895450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:46.897202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceaa16-0a89-496f-a47c-746a75da012e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:46.903279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 126/253] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/role_assignments?user.id=829da7c330a74d17ad277d8e5064be9e&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:46.914517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f963-9d3e-45f6-b893-4bcfc720e7a0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:46.914517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f963-9d3e-45f6-b893-4bcfc720e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:46.914517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f963-9d3e-45f6-b893-4bcfc720e7a0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:46.914517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 127/254] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:46.914517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f963-9d3e-45f6-b893-4bcfc720e7a0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:46.957246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.058832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c479-ba6c-4f4b-ac88-711aeb92fc30 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.072488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.074466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f963-9d3e-45f6-b893-4bcfc720e7a0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.119314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.119892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.120214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.120490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.121715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.123231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8705530-d614-4b2d-8b4d-2119227bc2fa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:47.125023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 128/255] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:47.126223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.126453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.126736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.137363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.138045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.138329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.138645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.139331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:47.139696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.141241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:47.146846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:47.148118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:47.168751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 128/256] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:47.169387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.230333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 129/257] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:47.231198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.350187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.358159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f47f2-a24b-4ce4-8c1f-be945975d96e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.383767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80fafd-031c-4717-872f-eab7ee420120 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.395807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.396490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.396774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.397050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] PATH_INFO: `/v3/users/b2d3c8c683094c739b2def732361a8bd` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.398222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] RBAC: Authorizing `identity:get_user(user_id=b2d3c8c683094c739b2def732361a8bd)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.399669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:47.401514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 130/258] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:47 2022] GET /identity/v3/users/b2d3c8c683094c739b2def732361a8bd => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:47.410386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.416372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.460115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.460834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.461117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.461387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.548322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f310cc-faa2-41ca-b1c3-0739b03f9db3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.576434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.578334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:47.589132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.589986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.590414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.590832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.592162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.594315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:47.596983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 131/259] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:47 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:47.605594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.680430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.738778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 129/260] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:47.739946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.763100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:47.849919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b7db-153c-4e29-8c30-8392aed959d5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.881906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0d876-816f-44df-8d5b-c7138fe1947b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:47.887383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.888205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.888654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.889860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.902762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:47.908498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:47.909818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:50:47.910657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:47.913371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 130/261] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:50:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:47.914644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:47.941054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:47.941990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:47.942447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:47.942914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/users/b2d3c8c683094c739b2def732361a8bd/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:47.945069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, user_id=b2d3c8c683094c739b2def732361a8bd, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:47.946691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.017907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 132/262] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:47 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/users/b2d3c8c683094c739b2def732361a8bd/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:48.019768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:48.128558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:48.172952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:48.184576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a79f5-d41b-4ec3-8522-00f080b9bc64 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:48.187144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449df-c2ce-404d-ab87-518dcab98e60 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:48.225318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:48.225862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:48.226146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:48.226485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:48.227195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:48.227499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:48.229123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.240137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 133/263] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:50:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:48.245789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:48.284145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:48.284145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:48.284145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:48.284145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:48.285117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:48.286638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.288714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 131/264] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:47 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:48.294751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:48.422468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d9bb-f37c-40f2-a3ed-2bd1a982df33 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:48.450620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ce07a-7cc6-4f33-a8cd-84cb0e2eb7a3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:48.487747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:48.488319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:48.488587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:48.488849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] PATH_INFO: `/v3/users/86f446d052c4496e94ef167478434b54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:48.490102 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] RBAC: Authorizing `identity:get_user(user_id=86f446d052c4496e94ef167478434b54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:48.491554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.493471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 134/265] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:48 2022] GET /identity/v3/users/86f446d052c4496e94ef167478434b54 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:48.500052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:48.519363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:48.520215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:48.520628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:48.521055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:48.521911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=86f446d052c4496e94ef167478434b54) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:48.522354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:48.523914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.530087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 132/266] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:48 2022] GET /identity/v3/role_assignments?user.id=86f446d052c4496e94ef167478434b54&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:48.544454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:48.653837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8d535-bcb8-414a-b737-b127e3063b90 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:48.690986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:48.691888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:48.692351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:48.692741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:48.765737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:48.767212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ac1f3-943e-4066-a602-35f6cc4fff20 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:48.790915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:48.884575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 135/267] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:48.890572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:48.920570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:49.015635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063b9b-b06d-46f8-a4d5-beddbe6a2c1a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.016035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063b9b-b06d-46f8-a4d5-beddbe6a2c1a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.016220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc063b9b-b06d-46f8-a4d5-beddbe6a2c1a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.017567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 136/268] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:49.023728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.023964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.024260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.036428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7ec1-e839-4794-bc22-56cbee676076 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:49.045355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:49.046556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:49.075110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:49.076098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.076588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.077153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.078629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:49.080708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:49.082557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 133/269] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:48 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:49.089122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:49.122304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 137/270] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:49.176870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:49.200240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b46f4b-7e03-4d14-9320-6c4a447f28f5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:49.244469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:49.245427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.245899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.246399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.247314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=86f446d052c4496e94ef167478434b54) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:49.247814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:49.249473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:49.257103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 134/271] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:49 2022] GET /identity/v3/role_assignments?user.id=86f446d052c4496e94ef167478434b54&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7cd14d5c176345a398d14136efaa152f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:49.439434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:49.495269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:49.554573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8b14-df42-42fb-8903-e6f504befa19 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:49.590246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:49.590890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.591475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.591751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.592965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:49.594478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd35476-64c6-4bef-ad25-2ed8569ef0ee None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:49.596885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 138/272] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:49.602413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:49.631324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfbda-1174-44ef-8312-b532fe563556 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.631656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfbda-1174-44ef-8312-b532fe563556 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.631882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfbda-1174-44ef-8312-b532fe563556 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.633579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 139/273] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:49.640112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.640388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.640666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.660390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:49.661593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:49.723116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982a525-f1d8-4a5c-9245-4aa1544c6fd8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:49.742152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 140/274] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:49.762638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:49.763637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:49.764145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:49.764636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:49.765486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:49.767180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9437-3639-4a2d-8f66-2c814893f61b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:49.870085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:49.874902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 135/275] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:50:49 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:50.016857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.070763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:50.095144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7f9e-95f2-4e7a-a17c-885df5d33556 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.095707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7f9e-95f2-4e7a-a17c-885df5d33556 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.095928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7f9e-95f2-4e7a-a17c-885df5d33556 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.098803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 136/276] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:50.105203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.105541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.105823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.125859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:50.126818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:50.129119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb18a9-7b88-43bb-8ed6-b3f594942d83 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:50.170040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:50.170707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.170986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.171309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.184534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:50.190092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:50.191055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:50.191865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:50.192483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 141/277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:50.197836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.224845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 137/278] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:50.321480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193eba8-7e3e-4b56-bd75-efdfe94e9ea8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:50.334117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:50.367168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:50.367823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.368132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.368402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.369063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:50.369361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:50.370744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:50.381733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 142/279] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:50.387618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.515934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.534654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5f2c-4868-442e-a76c-5efc53d1375b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:50.587820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:50.605470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:50.606170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.606446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.606716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] PATH_INFO: `/v3/users/f6800ba3e2e14f83a859f5e35978c1ff` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.625640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] RBAC: Authorizing `identity:get_user(user_id=f6800ba3e2e14f83a859f5e35978c1ff)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:50.628010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:50.630144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 138/280] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/users/f6800ba3e2e14f83a859f5e35978c1ff => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:50.630254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c690-1ae1-43d1-bf3b-1eef9dbe7869 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:50.635797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.701340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:50.701992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.702273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.702544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.732307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:50.739886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:50.741232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:50.742045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:50.744782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 143/281] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:50.748072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:50.787708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:50.791080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08ce9-1586-48c3-b94c-9dfa1e7f2923 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:50.869935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:50.870558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.870840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.871116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.871850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, user.id=f6800ba3e2e14f83a859f5e35978c1ff, scope.system=all) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:50.872188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:50.873645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ab802-77d5-42ea-9c3b-020866816a8e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:50.892000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 139/282] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/role_assignments?user.id=f6800ba3e2e14f83a859f5e35978c1ff&scope.system=all&role.id=b086728fbde044b28647906c294e9a64 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:50.899085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31656-b175-4720-a2bc-f95be2c084b2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.899367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31656-b175-4720-a2bc-f95be2c084b2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.899640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31656-b175-4720-a2bc-f95be2c084b2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.904162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 140/283] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:50.906698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295f55-6288-4e37-8b38-51891660179e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:50.906982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295f55-6288-4e37-8b38-51891660179e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:50.907257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b295f55-6288-4e37-8b38-51891660179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:50.933697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2b295f55-6288-4e37-8b38-51891660179e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:50.935014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2b295f55-6288-4e37-8b38-51891660179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:50.945157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043c820-3cf4-4b90-acb0-2088d79844fd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.001881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.002640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.003043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.003316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.004023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:51.004331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:51.005755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:51.024363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 144/284] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:51.030959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.062339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:51.101727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 141/285] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:51.177234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:51.186488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa199-ded8-46b3-96f5-e7fc2ae65305 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.225748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.226264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.226582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.226861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] PATH_INFO: `/v3/users/829da7c330a74d17ad277d8e5064be9e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.228069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] RBAC: Authorizing `identity:get_user(user_id=829da7c330a74d17ad277d8e5064be9e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:51.229639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:51.232052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 145/286] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:51 2022] GET /identity/v3/users/829da7c330a74d17ad277d8e5064be9e => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:51.237352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b295f55-6288-4e37-8b38-51891660179e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.358689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b295f55-6288-4e37-8b38-51891660179e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.403120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.403751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.404056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.404336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.405452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:51.406880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:51.409377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 142/287] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:51 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:51.415028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.457015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.520322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:51.572874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1c63b-394f-40a1-9db0-593c792a491d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.602799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0551-fd64-40bd-9faf-0305e0a63834 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.614056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.615314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.615671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.616040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.627808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:51.634183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:51.635065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:51.635852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 143/288] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:50:51.641536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.701003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.702003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.702452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.702894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/users/829da7c330a74d17ad277d8e5064be9e/roles/7c5113bc949c4a0885dcff8e0b4c8a54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.707765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, user_id=829da7c330a74d17ad277d8e5064be9e, role_id=7c5113bc949c4a0885dcff8e0b4c8a54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:51.709495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:51.781714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 146/289] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:50:51 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/users/829da7c330a74d17ad277d8e5064be9e/roles/7c5113bc949c4a0885dcff8e0b4c8a54 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:51.784465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6956cb-3b5e-4f66-80f1-c4a609e48a60 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:51.808248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:51.846496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:51.847199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:51.847475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:51.847747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:51.848473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:51.848777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:51.850209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:51.863518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 144/290] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:51.869588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:51.915769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:52.013179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52279ecc-6b27-45fa-bb9d-729c25c29abe None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:52.053296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:52.053942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.054220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.054493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] PATH_INFO: `/v3/users/b2d3c8c683094c739b2def732361a8bd` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.056699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=b2d3c8c683094c739b2def732361a8bd)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:52.058366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:52.060495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 147/291] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:51 2022] GET /identity/v3/users/b2d3c8c683094c739b2def732361a8bd => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:52.066314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:52.215583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c954-833f-4658-988c-4e7b88061bbe None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:52.275874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:52.276158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.276401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.276681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.328021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:52.354642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:52.356118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:52.486715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 145/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:52.492335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:52.609610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:52.625191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54040c0d-cfb5-4b07-a058-bc7846908ea4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:52.675148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:52.675818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.676123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.676395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.677633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:52.679111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014296f-0347-4053-863d-a6107b1167a8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:52.680854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 148/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:52 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:52.687132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:52.791500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5409-a7d0-44e5-a613-2c0dd9bdd2c8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.792026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5409-a7d0-44e5-a613-2c0dd9bdd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.792266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5409-a7d0-44e5-a613-2c0dd9bdd2c8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.794794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 149/294] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:52.797018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:52.798753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.799042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.799399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.818635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:52.819577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:52.833025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed44d-ad00-46d5-8de4-651aeccdff58 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:52.873703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:52.874671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.875159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.875627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.876563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=b2d3c8c683094c739b2def732361a8bd) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:52.877066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:52.879286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61221960-112c-40e3-9627-049da4ff44b8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:52.890773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 146/295] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:52 2022] GET /identity/v3/role_assignments?user.id=b2d3c8c683094c739b2def732361a8bd&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=b086728fbde044b28647906c294e9a64 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:52.895705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2152-ec0b-4c4a-9f53-7205289a640f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.896473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2152-ec0b-4c4a-9f53-7205289a640f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.896747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2152-ec0b-4c4a-9f53-7205289a640f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.898323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 147/296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:52.904972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:52.905636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:52.906075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:52.926926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:52.928601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:52.942140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 150/297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:53.129410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 148/298] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:53.284453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.380496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:53.397212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be286be0-62c3-42fa-98a2-a7e80dcc25b2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:53.429871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.434613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:53.435246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.435525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.435803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.451118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:53.456251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:53.457226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:53.458013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 151/299] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:53.463265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.532714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:53.583956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb122db-ab50-4c94-a491-115512b6f5f9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:53.594409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca9a19-1510-4f5a-b966-c287762feeed None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:53.631905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:53.632499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.632778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.633046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.634148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:53.635599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:53.635948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:53.636795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.637259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.637603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 149/300] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:53.637932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.638599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:53.638905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:53.641863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c726a-f650-40be-b1ad-9b776933e78b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:53.643503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.650766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 152/301] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:53.652699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040106d2-c721-4eb0-ab67-6d0ec9f75665 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.652699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040106d2-c721-4eb0-ab67-6d0ec9f75665 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.652699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040106d2-c721-4eb0-ab67-6d0ec9f75665 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.654033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 153/302] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:53.657374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040106d2-c721-4eb0-ab67-6d0ec9f75665 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.670226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:53.749788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750452-425b-483d-b314-1dba4b80e519 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:53.763701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040106d2-c721-4eb0-ab67-6d0ec9f75665 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:53.788183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:53.788798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.789078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.789357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] PATH_INFO: `/v3/groups` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.790001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:53.791436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:53.795439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:53.801436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:53.802055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.802377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.802633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] PATH_INFO: `/v3/users/598e607e848246f6842571cf8d6e03f2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.815962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] RBAC: Authorizing `identity:get_user(user_id=598e607e848246f6842571cf8d6e03f2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:53.817397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4876b-7472-4d29-bf8a-aafb08fb3ebe None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:53.818996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 154/303] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:53 2022] GET /identity/v3/users/598e607e848246f6842571cf8d6e03f2 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:53.820285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:53.820565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:53.820833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:53.838451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:53.839608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:53.863830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 150/304] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Sep 13 07:50:53 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:53.864933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:53.921170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:53.930169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 155/305] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:54.010856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab84-3e6d-4c7c-9879-c8e6ac3f784e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.052758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.053492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.053779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.054056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.054795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, user.id=598e607e848246f6842571cf8d6e03f2, scope.system=all) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:54.055106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:54.056592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:54.063333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 151/306] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 07:50:53 2022] GET /identity/v3/role_assignments?user.id=598e607e848246f6842571cf8d6e03f2&scope.system=all&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:54.215025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:54.325268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc5dc7-0c18-4ca9-b99e-2004371f1b79 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.365978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.366616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.366894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.367166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.378773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-20311cf0-4b4e-438e-8d2f-977b097a403a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:54.383625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:54.384553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:54.385340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 156/307] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:54.390835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:54.456295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:54.457936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937278-7ea6-4abf-bb48-a59ab1cda87b None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.458225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937278-7ea6-4abf-bb48-a59ab1cda87b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.458504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937278-7ea6-4abf-bb48-a59ab1cda87b None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.460012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 157/308] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:54.465476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.466073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.466508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.485724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:54.487355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:54.513987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47768e2-574c-4a56-b1a9-edaa49fe2aa9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.548778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:54.558226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.558849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.559133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.559409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.563155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:54.563155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:54.563320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 158/309] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:50:54.563389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:54.572091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 152/310] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:54.577713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:54.687963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba3a74-2af4-41d1-a2a4-90dfa70b9534 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.724025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.724591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.724870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.725144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] PATH_INFO: `/v3/users/f6800ba3e2e14f83a859f5e35978c1ff` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.726277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] RBAC: Authorizing `identity:get_user(user_id=f6800ba3e2e14f83a859f5e35978c1ff)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:54.727726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:54.729676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 159/311] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:54 2022] GET /identity/v3/users/f6800ba3e2e14f83a859f5e35978c1ff => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:54.734955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:54.840997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:54.842836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9f38-ce67-4a5a-9018-419fde197bd7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.865170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:54.880220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.880856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.881146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.881426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] PATH_INFO: `/v3/system/users/f6800ba3e2e14f83a859f5e35978c1ff/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:54.882887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f6800ba3e2e14f83a859f5e35978c1ff, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:54.884643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:54.904998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:54.951545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837d19-6214-45bc-a217-0a314e385c84 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:54.985140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 153/312] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Sep 13 07:50:54 2022] PUT /identity/v3/system/users/f6800ba3e2e14f83a859f5e35978c1ff/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:50:54.990831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:54.991845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:54.992323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:54.992849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:55.015774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:55.022519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:55.023498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:55.024347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:55.030850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 160/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:55.033246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:55.156246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118bfa9-b58e-478c-9541-2348c25d2fd2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:55.194162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f836c-5183-40ea-869d-754b45314397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:55.194786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f836c-5183-40ea-869d-754b45314397 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:55.195070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f836c-5183-40ea-869d-754b45314397 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:55.195349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f836c-5183-40ea-869d-754b45314397 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:55.196041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f836c-5183-40ea-869d-754b45314397 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:55.196354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f836c-5183-40ea-869d-754b45314397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:55.197744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f836c-5183-40ea-869d-754b45314397 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:55.207357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 154/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:55.213283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:55.333593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a757-c270-46f7-a003-c846de97dae2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:55.348433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:55.369934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:55.371003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:55.371505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:55.371997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] PATH_INFO: `/v3/users/829da7c330a74d17ad277d8e5064be9e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:55.373330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] RBAC: Authorizing `identity:get_user(user_id=829da7c330a74d17ad277d8e5064be9e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:55.375084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:55.381875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 161/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:55 2022] GET /identity/v3/users/829da7c330a74d17ad277d8e5064be9e => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:55.383435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f836c-5183-40ea-869d-754b45314397 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:55.434232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:55.493525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f836c-5183-40ea-869d-754b45314397 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:55.532518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:55.533057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:55.533339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:55.533690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:55.603821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:55.605315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:55.651209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:55.707371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 155/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:50:55.713225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:55.821629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b8c1-625e-4e34-b1bf-449cb00382ae None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:55.857532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:55.859117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:55.859617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:55.860162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:55.861483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:55.863309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a83a-86e2-4aed-a5bb-f4706e5ac908 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:55.868684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 162/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:50:55 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:55.873079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:55.980626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4650b6f-eb40-4742-999e-b5acca1d5dc8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:56.015852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:56.016497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.016779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.017055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.017784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, scope.project.id=c44a581892a64ee188bf77000a664f32, user.id=829da7c330a74d17ad277d8e5064be9e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:56.018784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:56.020300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515c9d-a010-4fd5-91ff-486fc72729db None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:56.026494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 156/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:50:55 2022] GET /identity/v3/role_assignments?user.id=829da7c330a74d17ad277d8e5064be9e&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:56.173475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254a0b-a046-4e7a-9fb2-d9230ebc83d8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.173775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254a0b-a046-4e7a-9fb2-d9230ebc83d8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.173952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254a0b-a046-4e7a-9fb2-d9230ebc83d8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.176199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 163/319] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:56.181893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d633f4-eaa4-4f8f-93ba-9e1f8eee2191 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.182519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d633f4-eaa4-4f8f-93ba-9e1f8eee2191 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.182997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d633f4-eaa4-4f8f-93ba-9e1f8eee2191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.202830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-82d633f4-eaa4-4f8f-93ba-9e1f8eee2191 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:56.204507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-82d633f4-eaa4-4f8f-93ba-9e1f8eee2191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:56.208732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:56.294197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 157/320] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:56.360449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bdb6-e3ff-4fac-9cc8-fd8860497ce4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.361049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bdb6-e3ff-4fac-9cc8-fd8860497ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.361488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1bdb6-e3ff-4fac-9cc8-fd8860497ce4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.363163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 164/321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:56.368600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.368880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.369153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.387784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:56.388989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:56.473616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 158/322] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:56.665745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1bdb6-e3ff-4fac-9cc8-fd8860497ce4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:56.721286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:56.774192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1bdb6-e3ff-4fac-9cc8-fd8860497ce4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:56.813016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:56.814010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:56.814486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:56.815082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:56.817026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:56.818769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:56.820597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 165/323] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:56.828737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:56.939927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:56.948277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:56.990690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7750-b043-4fad-abc0-04608541a7b7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.025903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.026437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.026712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.027092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] PATH_INFO: `/v3/groups` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.027711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:57.029275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:57.061058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decbd1c-7a72-4dd4-9ec4-66977410adcd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.079349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:57.096970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.097735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.098012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.098281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.108641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:57.113497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:57.114405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:50:57.115195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 166/324] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:57.120260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:57.131104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 159/325] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Sep 13 07:50:56 2022] POST /identity/v3/groups => generated 226 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:50:57.236217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8222bf-647b-4e88-ac4e-a74837bf5d99 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.283536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.284662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.284937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.285205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.285882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:57.286189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:57.287849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13215-8243-46da-808e-bdbe84366feb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:57.297184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 167/326] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:50:57.304120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:57.345820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd397e-7c24-44d5-b26c-0344dde8d30c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.346189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd397e-7c24-44d5-b26c-0344dde8d30c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.346471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd397e-7c24-44d5-b26c-0344dde8d30c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.347802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 168/327] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:50:57.353272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.353552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.353850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.372633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:57.373834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:50:57.414235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b6b8-5b80-4083-b02d-7d8a0784694c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.414442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:57.452263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:57.456917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 169/328] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:50:57.459625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.461387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.461387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.461387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] PATH_INFO: `/v3/users/598e607e848246f6842571cf8d6e03f2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.462329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] RBAC: Authorizing `identity:get_user(user_id=598e607e848246f6842571cf8d6e03f2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:57.463864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:57.465698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 160/329] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:57 2022] GET /identity/v3/users/598e607e848246f6842571cf8d6e03f2 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:57.471375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:57.577241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac43923-db6e-420e-b88b-c37f7b57ffb5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.617918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.618581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.618858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.619123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] PATH_INFO: `/v3/system/users/598e607e848246f6842571cf8d6e03f2/roles/7c5113bc949c4a0885dcff8e0b4c8a54` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.620779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=598e607e848246f6842571cf8d6e03f2, role_id=7c5113bc949c4a0885dcff8e0b4c8a54)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:57.623021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:57.680722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 170/330] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Sep 13 07:50:57 2022] PUT /identity/v3/system/users/598e607e848246f6842571cf8d6e03f2/roles/7c5113bc949c4a0885dcff8e0b4c8a54 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:50:57.740978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:57.867376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef7f9-2a10-41b5-a96f-ec7469137706 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:57.909782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:57.910438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:57.910822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:57.911101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:57.922425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:50:57.928174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:50:57.933448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:50:57.934231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 161/331] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:50:57.936619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:57.986734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:58.070191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a34fe-cf6d-4387-801f-8967fc273f53 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:58.118005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:58.118575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:58.118857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:58.119129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:58.119796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:58.120172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:58.121548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:58.132573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 171/332] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:58.137499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:58.212459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:58.265034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54205a-d5b3-49b3-ad0b-93d037c4ba5d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:58.318305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:58.318951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:58.319278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:58.319559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] PATH_INFO: `/v3/users/f6800ba3e2e14f83a859f5e35978c1ff` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:58.320745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] RBAC: Authorizing `identity:get_user(user_id=f6800ba3e2e14f83a859f5e35978c1ff)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:58.322199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f8fb-d7c9-4d7b-8eaa-56f07df6a899 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:58.323786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 162/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:50:58 2022] GET /identity/v3/users/f6800ba3e2e14f83a859f5e35978c1ff => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:58.329725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:50:58.434964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:50:58.443307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99767ff-dd4e-491a-95fd-d962c1f67214 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:50:58.483234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:50:58.483856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:58.484422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:58.484705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:58.485490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] RBAC: Adding query filter params (role.id=b086728fbde044b28647906c294e9a64, user.id=f6800ba3e2e14f83a859f5e35978c1ff, scope.system=all) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:50:58.486017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:50:58.488541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a824-797c-4752-a3ba-d7c9b92c0c77 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:50:58.502258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 172/334] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 07:50:58 2022] GET /identity/v3/role_assignments?user.id=f6800ba3e2e14f83a859f5e35978c1ff&scope.system=all&role.id=b086728fbde044b28647906c294e9a64 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:50:59.921732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3408e4-5c7e-4c85-a397-5eeeb3baba07 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:59.922246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3408e4-5c7e-4c85-a397-5eeeb3baba07 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:59.922352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3408e4-5c7e-4c85-a397-5eeeb3baba07 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:59.924502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 163/335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:50:59.929439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae8e7-40ee-47c6-85d2-2cb634404fb7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:50:59.929877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae8e7-40ee-47c6-85d2-2cb634404fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:50:59.930018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae8e7-40ee-47c6-85d2-2cb634404fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:50:59.953063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-624ae8e7-40ee-47c6-85d2-2cb634404fb7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:50:59.954318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-624ae8e7-40ee-47c6-85d2-2cb634404fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:00.032910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 173/336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:00.399557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3408e4-5c7e-4c85-a397-5eeeb3baba07 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:00.508073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4eaad-16ec-4378-b9b9-e37f55bc12dd None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.508427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4eaad-16ec-4378-b9b9-e37f55bc12dd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.508870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4eaad-16ec-4378-b9b9-e37f55bc12dd None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.510722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 174/337] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:00.517458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.518047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.518522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.537408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3408e4-5c7e-4c85-a397-5eeeb3baba07 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:00.540999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:00.542433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:00.587945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:00.612824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:00.613483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.613766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.614044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.644995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:00.646247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 175/338] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1e046c88-18d1-4665-bbc7-e34329642217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:00.652737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:00.653622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:00.654433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 164/339] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:00.661410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:00.684527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:00.690006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3301d7-f3df-41ff-8c46-a5284a787fc0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.690368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3301d7-f3df-41ff-8c46-a5284a787fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.690662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3301d7-f3df-41ff-8c46-a5284a787fc0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.692312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 165/340] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:00.697387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.697939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.698415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.733005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:00.734554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:00.794490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d485f-4525-4068-8458-c9ff3a2d1ce9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:00.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:00.846669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:00.847080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:00.847489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:00.848313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:00.848766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:00.850262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:00.863744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 176/341] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:00.869588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:00.879442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 166/342] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:00.972472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.004548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c789-1dcd-485b-beb3-9efa01787af9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.047595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.048159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.048440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.048710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.128341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:01.129787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:01.149561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.258048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.335114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 177/343] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:01.340534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.396458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bfd85-2f82-45e9-9c66-6565974bd3ad None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.430099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.463195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.463842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.464145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.464412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.488913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:01.493827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cde10-dc4b-4ea2-999f-c75f1ca6a03c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:01.494115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:01.495138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:01.496157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:01.498323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 167/344] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:01.501599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.541599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.542263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.542542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.542815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.543963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:01.545450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:01.547608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 178/345] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:01.548567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.603960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.651477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7021df-7cd1-408b-8c9f-2e9a8a2d7de9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.688123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d6f2b-60c4-475f-9879-71508e8916b2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.713059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.713691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.713968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.714237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.735221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:01.740359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:01.741342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 07:51:01.742157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:01.742761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 168/346] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:01.747886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.754644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.755255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.755533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.755802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.756499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:01.756798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:01.758162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d25bf-a66f-4637-b7b6-15cef5ceb2cc None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:01.767531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 179/347] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:01.769788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09a3d-ea8d-4a0a-b593-bf8e13388717 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.770081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09a3d-ea8d-4a0a-b593-bf8e13388717 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.770351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09a3d-ea8d-4a0a-b593-bf8e13388717 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.771851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 180/348] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:01.776856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09a3d-ea8d-4a0a-b593-bf8e13388717 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.802843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.883693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe14f6-fe31-4110-bace-088c2bc6d1c1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.925447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09a3d-ea8d-4a0a-b593-bf8e13388717 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:01.935613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:01.942115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.943053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.943448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.943722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.952972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:01.954422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:01.956749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 169/349] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:01.957517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:01.974978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:01.975773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.976475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.976758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:01.977423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:01.977726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:01.979077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53247b-d4b1-4cc5-9626-30df2ce5e609 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:01.989877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 181/350] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:01.991817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b5c4-3172-420e-b331-bd6a7b216e7e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:01.992581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b5c4-3172-420e-b331-bd6a7b216e7e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:01.992581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b5c4-3172-420e-b331-bd6a7b216e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.013297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b482b5c4-3172-420e-b331-bd6a7b216e7e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:02.014723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b482b5c4-3172-420e-b331-bd6a7b216e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:02.082245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.087066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f231e8-3a61-4071-9b8a-9b1810851a51 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.110496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 182/351] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:02.113025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4136-5889-4eb0-8b7c-89b88b07680a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.113532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4136-5889-4eb0-8b7c-89b88b07680a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.114042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4136-5889-4eb0-8b7c-89b88b07680a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.116653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 183/352] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:02.117783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4136-5889-4eb0-8b7c-89b88b07680a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.144248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.144803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.145087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.145363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.247805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.248883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eae84-d844-4445-9e98-07aabd1d3409 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.261916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.270764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4136-5889-4eb0-8b7c-89b88b07680a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.319297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.319922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.320666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.320959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.321801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=b086728fbde044b28647906c294e9a64, scope.project.id=d7b44966f1844db59dec086347156e67) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:02.322263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.323871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.332347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 184/353] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=b086728fbde044b28647906c294e9a64 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:02.333576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.376621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.382581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 170/354] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:02.384231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.386503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.386503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.405793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:02.407171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:02.474933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058a58-639c-4dd0-80a4-988d4a55e39d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.510770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 171/355] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:02.512877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.542227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.543002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.543282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.543555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] PATH_INFO: `/v3/users/598e607e848246f6842571cf8d6e03f2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.544812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] RBAC: Authorizing `identity:get_user(user_id=598e607e848246f6842571cf8d6e03f2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.546281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.548479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 185/356] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/users/598e607e848246f6842571cf8d6e03f2 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:02.550946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.593001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.668817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866128-88a8-45ea-a09d-d9d3e63346de None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.688265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558781-4285-4ad4-a81a-380807a676ee None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.709570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.717164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.718058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.718338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.718611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.720497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.722842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.725108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 172/357] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:02.726337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.730600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.731247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.731530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.731809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.745088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0dd0cf07-6930-4d9e-95be-75b7c61af5f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:02.750069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:02.750939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:02.751730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 186/358] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:02.753004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850368-0faa-4c9b-81af-4a6c51ae84d1 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.753190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850368-0faa-4c9b-81af-4a6c51ae84d1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.753339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850368-0faa-4c9b-81af-4a6c51ae84d1 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.760176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 187/359] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:02.760176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67850368-0faa-4c9b-81af-4a6c51ae84d1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.881379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:02.892440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3b8f-e8ec-4181-a836-609ee9ea276f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.900723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67850368-0faa-4c9b-81af-4a6c51ae84d1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:02.941673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.942209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.942564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.942838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.943575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] RBAC: Adding query filter params (role.id=7c5113bc949c4a0885dcff8e0b4c8a54, user.id=598e607e848246f6842571cf8d6e03f2, scope.system=all) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:02.943884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.944517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:02.945159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.945327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fc777-48b4-4fd9-aa4f-454810eee286 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.945473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.945714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.946818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:02.948275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:02.953004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 188/360] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:02.953004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:02.965026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 173/361] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/role_assignments?user.id=598e607e848246f6842571cf8d6e03f2&scope.system=all&role.id=7c5113bc949c4a0885dcff8e0b4c8a54 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:02.966448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:02.966731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:02.967001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:02.995420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:03.001717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:03.078806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.098614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e46d4-076e-496f-8c44-ec29f00bd51d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.099519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 174/362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:03.101158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.152120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.153131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.154059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.154556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.155891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:03.156420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:03.158252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:03.171129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 189/363] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:03.173127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.200871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.223287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93e0c7-b078-4aee-9f0d-ac2204c2d788 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.284749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.285424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.285785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.286067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.307299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:03.312834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:03.313733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 175/364] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:03.315754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.332532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4621-7281-4987-bade-a94a7e4cc64c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.376478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.378324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.378914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.379386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.380334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=d7b44966f1844db59dec086347156e67) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:03.381105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:03.382111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.384401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:03.395696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 190/365] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7cd14d5c176345a398d14136efaa152f => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:03.397048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.480051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b17a5-fa61-4048-bc0d-99d10cb326d5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.524358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.540483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.541561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.542043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.542488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b8b2-a5ee-4813-8948-b7ce1807df89 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.542755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.587447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.588114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.588401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.588680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.589374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:03.589681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:03.591121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:03.604194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 191/366] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:03.605081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.634978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:03.637100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:03.694448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.720766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34046797-8972-45a2-a0ab-02f7c3ed164a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.757936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 176/367] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:03.759683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.760648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.761289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.761572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.761846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.780254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:03.787472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:03.788394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:03.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:03.792332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 192/368] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:03.793404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:03.803946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.904031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f71cc-7348-4b66-ad88-ddc2b9ef4360 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.936412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b565e8-8d4a-4dd9-830f-727dd1b07e19 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:03.959573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.960235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.960517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.960794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.981304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:03.989659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:03.991125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:03.991572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:03.992801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:03.993349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:03.994880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:03.997368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 193/369] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:03.998324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.055000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.057027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.092789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.119825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae7e94-7a57-420e-9175-54c25a63f68f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.161141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.161766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.162304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.162704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.163375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:04.163680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.165190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.175238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 194/370] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:04.176691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.194374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 177/371] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:04.195532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.249178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.303047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203976-7cbd-4f28-901e-bd7d5cccde58 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.320878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1d15-6e49-4bcc-a3dc-d127ab3b9bb9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.348023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.348934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.349228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.349516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.351083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.353120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.355414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 195/372] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:04.356602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.360946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.364774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.365655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.366088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.366515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.448593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.450333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.492194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fbac-1dc9-46b8-967e-c5f8be4998bd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.515128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.544172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.544875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.545157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.545430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.546558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.547994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.550172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 196/373] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:04.550944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.589562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 178/374] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:04.590710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.652249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.695296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81069653-2510-42f0-9a8e-f659e35b30bd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.710381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888401-7157-4d07-8584-9c42277dbdc6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.744201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.746249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.746531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.746807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.747536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=c44a581892a64ee188bf77000a664f32) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:04.747851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.749324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.763247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 197/375] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7cd14d5c176345a398d14136efaa152f => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:04.763917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.766771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:04.767418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:04.767728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:04.768745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:04.770258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:04.774000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:04.780795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 179/376] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:04.781760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:04.818060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:04.959548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4883a1-4fcd-4647-b34a-ca164819131e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:04.968780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae0c68-e518-4365-8fa3-ff000e48930f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:05.003143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:05.004171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.004674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.005197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] PATH_INFO: `/v3/projects/6e508fcc9dce499eae1e042c37e06fe3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.006615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e508fcc9dce499eae1e042c37e06fe3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:05.008493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:05.010530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 198/377] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/projects/6e508fcc9dce499eae1e042c37e06fe3 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:05.016705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:05.017600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:05.019365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.019741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.020145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.021219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=b086728fbde044b28647906c294e9a64, scope.project.id=c44a581892a64ee188bf77000a664f32) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:05.021630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:05.022243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:05.024249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4228-dba8-4a2b-8cdd-cc19004f660d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:05.031303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 180/378] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:04 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=b086728fbde044b28647906c294e9a64 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:05.116085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cdab-ee7b-45a2-8fe0-01894e679be3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.116722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cdab-ee7b-45a2-8fe0-01894e679be3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.118187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2cdab-ee7b-45a2-8fe0-01894e679be3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.120706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 181/379] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:05.130633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.130940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.131183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.173151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:05.174436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:05.176441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c517d9-1c57-48e9-99c3-8310cbc68ef2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:05.225630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:05.227017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.227299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.227575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] PATH_INFO: `/v3/groups/47adc45045df4bf28ec42d58b9fee572` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.243849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] RBAC: Authorizing `identity:get_group(group_id=47adc45045df4bf28ec42d58b9fee572)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:05.245678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:05.247727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 199/380] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:05 2022] GET /identity/v3/groups/47adc45045df4bf28ec42d58b9fee572 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:05.254770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:05.304106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 182/381] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:05.351068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:05.386499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3809c-0fe9-4cd6-a33c-577623202e7b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:05.427828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:05.428471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.428754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.429030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.429753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] RBAC: Adding query filter params (group.id=47adc45045df4bf28ec42d58b9fee572, role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=6e508fcc9dce499eae1e042c37e06fe3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:05.430068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:05.431482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:05.437868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 200/382] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:05 2022] GET /identity/v3/role_assignments?group.id=47adc45045df4bf28ec42d58b9fee572&scope.project.id=6e508fcc9dce499eae1e042c37e06fe3&role.id=a902366353714eaeb9753ac3ce606c58 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:05.741361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:05.754068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:05.858241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c8b04-9060-4e17-8b38-4743724cac66 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:05.904846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:05.905555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:05.905828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:05.906095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:05.922491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:05.927881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:05.928779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:05.929969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 183/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:05.937546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:06.082166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309cf3-e639-48d1-bb20-ee0d0c32f6cd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:06.114141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:06.129622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:06.130619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.131118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.131591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.132485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:06.133003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:06.134636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5aebb-30e1-49bf-9186-c02573b45de3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:06.149954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 201/384] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:06.155203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:06.160500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a09f2-98d4-4b0a-9080-11a775ebd783 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.161166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a09f2-98d4-4b0a-9080-11a775ebd783 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.161666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a09f2-98d4-4b0a-9080-11a775ebd783 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.163842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 202/385] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:06.173350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.173873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.174591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.212296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:06.216103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:06.316219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:06.387449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 203/386] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:06.395316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07412ae-afeb-4d8b-8dff-5d1ca915a7f1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:06.449351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:06.450014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.450296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.450573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.451721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:06.453220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:06.454975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 184/387] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:06 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:06.460702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:06.640297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf47ef-0095-4ddf-81f0-5a942b10484e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:06.668388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:06.679237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:06.679948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.680268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.688905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.688905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:06.688905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:06.688905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 204/388] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:06 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:06.691824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:06.803302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ee25-1e38-4f41-87ce-58567b240c42 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:06.841452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:06.842112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:06.842388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:06.842713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:06.844679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, group_id=493ee2d8c55e488298ff6aa90199cd2d, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:06.846878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:06.852263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:06.955146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 185/389] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 07:51:06 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:51:06.956547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:07.106240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870568a2-9f91-42bf-b6de-65a27474e2eb None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:07.151558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:07.152215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.152490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.152758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.167812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:07.172636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:07.173586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:07.174548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 205/390] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:07.180137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:07.330104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9ab6-f0e7-495a-8ff3-ef366df63e45 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:07.371136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:07.372144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.372638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.373118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.373995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:07.374514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:07.376183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:07.390886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 186/391] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:07.396907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:07.475080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:07.526640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b01b35-a002-48f8-92dc-9bc436eac9dd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:07.564389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:07.565113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.565382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.565645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.566746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:07.568183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:07.572169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 206/392] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:07 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:07.575170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:07.666299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:07.729111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39add56-8254-4102-8c32-7774863ef19e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:07.779176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:07.779741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.780043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.780321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.781464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:07.782894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c31990-1fc0-4c86-ade3-9116efbd267d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:07.785654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 187/393] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:07 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:07.791442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:07.847789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3c0d-fa67-4d0f-9e0a-4704a1350c79 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.848354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3c0d-fa67-4d0f-9e0a-4704a1350c79 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.848354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3c0d-fa67-4d0f-9e0a-4704a1350c79 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.852758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 188/394] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:07.858914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1cfa-1695-4bfe-8bcc-7cbcddc967a1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:07.859200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1cfa-1695-4bfe-8bcc-7cbcddc967a1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:07.859481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1cfa-1695-4bfe-8bcc-7cbcddc967a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:07.895630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a4cc1cfa-1695-4bfe-8bcc-7cbcddc967a1 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:07.895630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a4cc1cfa-1695-4bfe-8bcc-7cbcddc967a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:07.948906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9439-beec-4beb-801a-ce03717e5608 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:07.993081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:08.007838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 189/395] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:08.023096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:08.023763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.024064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.024338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.030397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] RBAC: Authorizing `identity:create_grant(project_id=d7b44966f1844db59dec086347156e67, group_id=493ee2d8c55e488298ff6aa90199cd2d, role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:08.031780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51dcda-0b16-4c2d-ad99-85dcd6775b5a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:08.114684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 207/396] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 07:51:07 2022] PUT /identity/v3/projects/d7b44966f1844db59dec086347156e67/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/7cd14d5c176345a398d14136efaa152f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:08.189859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53dca2-953c-41c9-8e94-45c3e6b2235c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.190502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53dca2-953c-41c9-8e94-45c3e6b2235c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.190988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53dca2-953c-41c9-8e94-45c3e6b2235c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.192890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 190/397] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:08.198426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f2d6-0063-425b-b2b4-586b1cfa0b60 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.198712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f2d6-0063-425b-b2b4-586b1cfa0b60 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.198985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f2d6-0063-425b-b2b4-586b1cfa0b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.225279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7502f2d6-0063-425b-b2b4-586b1cfa0b60 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:08.226516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7502f2d6-0063-425b-b2b4-586b1cfa0b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:08.336731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53dca2-953c-41c9-8e94-45c3e6b2235c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:08.338178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 208/398] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:08.391679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220ad-5470-4021-abb9-5a76d1957502 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.392061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220ad-5470-4021-abb9-5a76d1957502 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.392323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220ad-5470-4021-abb9-5a76d1957502 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.394665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 209/399] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:08.399947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.400594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.400594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.418187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:08.423130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:08.425792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:08.474482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53dca2-953c-41c9-8e94-45c3e6b2235c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:08.510519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 210/400] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:08.525005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:08.525638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.525965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.526236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.538072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:08.543043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:08.543930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:08.544908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 191/401] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:08.551933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:08.597583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:08.664027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca3225-a027-4822-8d71-7f81f405ea14 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:08.697170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:08.702057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:08.702675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.702948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.703214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.703871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:08.704209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:08.705711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:08.714878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 211/402] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:08.726318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:08.874718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02b14b-a990-4b1a-a03a-96eaa6556346 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:08.887046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:08.898663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27f59-3c7f-4443-bf69-103b828d81ef None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:08.917125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:08.919081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:08.919966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.920469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.921028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.922361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:08.924546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:08.926662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 212/403] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:08.927625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:08.935879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:08.936587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:08.936863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:08.937131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:08.948584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:08.953532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:08.954416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:08.955887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 192/404] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:08.961098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.054461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10c09-f4f7-4245-b54a-1f92cd44c00b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.070798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00f2ae-869f-4918-82ea-4938d5f7f0cb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.104332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.104968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.105441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.105992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.108394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.109128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.109505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.109876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.111117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.112990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.115019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 193/405] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.115951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.124712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:09.132205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:09.133294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:09.134281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 213/406] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:09.135154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.167565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.173625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.230913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd6e29-b7ed-42e8-aace-1c5541e491b9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.259912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958327-3ec7-4811-a4c5-89cc8a9df81c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.280940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.281825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.282320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.282780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.283784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:09.284326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.285960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.299839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 194/407] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.300995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.303066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.304090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.304446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.304823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.308096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, group_id=493ee2d8c55e488298ff6aa90199cd2d, role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.309602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.396566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 214/408] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 07:51:09 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/7cd14d5c176345a398d14136efaa152f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:09.397756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.424410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb231-bf17-4a0a-ba5a-870ce31c6a0f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.444158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.511544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.512301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.512578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.512847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.513517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:09.513817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.515514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.538716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 195/409] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.541776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.605411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.619217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55dcf-354b-4481-98c5-c7525dffa8b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.657231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.657795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.658082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.658639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.660096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.662252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.663579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 215/410] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.670769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.701041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc7cc3-f208-4d46-be46-cf5a127c2004 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.748178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.749118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.750703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.751136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] PATH_INFO: `/v3/groups/47adc45045df4bf28ec42d58b9fee572` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.755048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] RBAC: Authorizing `identity:get_group(group_id=47adc45045df4bf28ec42d58b9fee572)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.758053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 196/411] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/groups/47adc45045df4bf28ec42d58b9fee572 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.768451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.848615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e133-cc6f-482f-ae55-c7363d6609bd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.856342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.913233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.914161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.914161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.914355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.915487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.917133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcfd3b-b6f2-4d70-9435-216f732f1027 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.919143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 216/412] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.920375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ec63-dcfc-4de0-a1b1-1eb69c27f30d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.920657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ec63-dcfc-4de0-a1b1-1eb69c27f30d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.920931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ec63-dcfc-4de0-a1b1-1eb69c27f30d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.926608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 217/413] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:09.927278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ec63-dcfc-4de0-a1b1-1eb69c27f30d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:09.929703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b7d36-e4ca-4639-b333-311156ac1bff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:09.956564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:09.974308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:09.975522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.976245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.976749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] PATH_INFO: `/v3/projects/6e508fcc9dce499eae1e042c37e06fe3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:09.978303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] RBAC: Authorizing `identity:get_project(project_id=6e508fcc9dce499eae1e042c37e06fe3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:09.980645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c91ec-b79b-4ad9-9515-bde2e6c0cce3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:09.983264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 197/414] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:09 2022] GET /identity/v3/projects/6e508fcc9dce499eae1e042c37e06fe3 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:09.984649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:09.985075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:09.985512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.011683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:10.013206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:10.044810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ec63-dcfc-4de0-a1b1-1eb69c27f30d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:10.084124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:10.084857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.085135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.085462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.087555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c44a581892a64ee188bf77000a664f32, group_id=493ee2d8c55e488298ff6aa90199cd2d, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:10.088992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:10.101195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 198/415] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:10.110078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:10.143423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:10.178086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 218/416] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 07:51:09 2022] PUT /identity/v3/projects/c44a581892a64ee188bf77000a664f32/groups/493ee2d8c55e488298ff6aa90199cd2d/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:10.232280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323b73d-4dc2-46de-8415-dae9814b7f1a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:10.283195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:10.283921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.284232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.284508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] PATH_INFO: `/v3/projects/6e508fcc9dce499eae1e042c37e06fe3/groups/47adc45045df4bf28ec42d58b9fee572/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.286445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e508fcc9dce499eae1e042c37e06fe3, group_id=47adc45045df4bf28ec42d58b9fee572, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:10.288252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:10.409975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:10.412423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 199/417] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Sep 13 07:51:10 2022] PUT /identity/v3/projects/6e508fcc9dce499eae1e042c37e06fe3/groups/47adc45045df4bf28ec42d58b9fee572/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:10.526150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:10.547668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93be6-ec11-4b6c-8765-5b7d09451cf9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:10.599353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:10.600101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.600388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.600666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.618567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0780adf0-089c-4bee-99da-2a6a4c345ee0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:10.623928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:10.624839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:10.625902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 219/418] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:10.633477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:10.669456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f72ec-0bc3-4ec9-8b75-66b21318ed38 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.669737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f72ec-0bc3-4ec9-8b75-66b21318ed38 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.670436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f72ec-0bc3-4ec9-8b75-66b21318ed38 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.672897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 220/419] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:10.681514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.682260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.682423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.704128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:10.705627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:10.749672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:10.758413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b83-543f-448a-a890-4ab58303d3e2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:10.796104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 221/420] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:10.803394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:10.805123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:10.805123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:10.805123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:10.805400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] RBAC: Adding query filter params (name=member) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:10.805796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:10.807235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:10.817039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 200/421] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:10.822527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:10.930055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:10.959707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875c9db-03ce-4a1b-b290-53f6530e3796 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.004926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.005538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.005819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.006090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.085876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:11.087241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:11.161510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:11.170547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.198681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 222/422] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:11.206149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.312358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09023c9-6dc7-4b74-bc3e-dd773ff4d975 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.349702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.350308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.350600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.350876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.363167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:11.368739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:11.369671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:11.370443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 201/423] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:11.375915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.396336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:11.484236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c176a-a430-447d-9be3-44e6ec42c8b4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.505952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059599-0e47-4c82-9e88-17670a60af7a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.521696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.522316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.522596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.522870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.523540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:11.523850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:11.530065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:11.551286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 202/424] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:11.556435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.575756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.576426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.576706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.576979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.580822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:11.582293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:11.590787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 223/425] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:11.592751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.685211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:11.690660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:11.728245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2619d-f018-4ece-9f5d-720858ed1445 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.788025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5d21-e738-4c80-bf9a-5bac7ad77863 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:11.808690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.809636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.809636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.809895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.846766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:11.847404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:11.847684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:11.847957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:11.853331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:11.854796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:11.856669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 224/426] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:11.863029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:11.932476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:11.934029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:12.028413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:12.059397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 203/427] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 07:51:12.066977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:12.114142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c503ed-9d23-4a11-9270-29b650095c4a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:12.142937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:12.182801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:12.183799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.184313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.184815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.185735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=b086728fbde044b28647906c294e9a64, scope.project.id=d7b44966f1844db59dec086347156e67) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:12.186410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:12.189101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef9d1-2db5-4029-8788-4a4cb0faf3a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:12.190345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffbce0-c8bb-4995-889b-7fdf7e434a63 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:12.197320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 225/428] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:11 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=b086728fbde044b28647906c294e9a64 => generated 611 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:12.198648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408add8e-8033-409e-b848-6287c9d10ad5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.199031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408add8e-8033-409e-b848-6287c9d10ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.199421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408add8e-8033-409e-b848-6287c9d10ad5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.206709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 226/429] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:12.209200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.209971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.210452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.231347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:12.234337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:12.241849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:12.242557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.242839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.243111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] PATH_INFO: `/v3/projects/d7b44966f1844db59dec086347156e67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.244359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] RBAC: Authorizing `identity:get_project(project_id=d7b44966f1844db59dec086347156e67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:12.245804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:12.247809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 204/430] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:12 2022] GET /identity/v3/projects/d7b44966f1844db59dec086347156e67 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:12.253432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:12.324635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:12.339834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 227/431] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:12.410026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fd18-8afd-41df-9f1c-ac0823a578b0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:12.447142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:12.447775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.448078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.448349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.449530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:12.450957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:12.452858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 205/432] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:12 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:12.458716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:12.567950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51801-7aa7-4b0c-a00a-b6bccddf41fa None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:12.575782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:12.603737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:12.604375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.604652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.604922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.605640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=d7b44966f1844db59dec086347156e67) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:12.605945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:12.607365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:12.614983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 228/433] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:12 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=d7b44966f1844db59dec086347156e67&role.id=7cd14d5c176345a398d14136efaa152f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:12.686820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:12.808754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81371505-5d49-4299-ae4a-c77d79f9cd18 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:12.824553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:12.846380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:12.847967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.848468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.848979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.864198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5cc1f33e-0cb8-4024-9acb-252fa56bd0c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:12.869758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:12.870793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:12.871605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:12.872789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 206/434] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:12.880323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:12.992017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fceab-5419-441c-ab95-ade491c92db4 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:12.992449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fceab-5419-441c-ab95-ade491c92db4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:12.992729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fceab-5419-441c-ab95-ade491c92db4 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:12.994716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 207/435] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:13.003849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae703f-337e-444b-ba49-b5784f16a0b3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.004188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae703f-337e-444b-ba49-b5784f16a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.004457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae703f-337e-444b-ba49-b5784f16a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.007359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955192cc-67fb-4ea8-84ac-7eef894bf656 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.034970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-57ae703f-337e-444b-ba49-b5784f16a0b3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:13.039336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-57ae703f-337e-444b-ba49-b5784f16a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:13.051087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.051705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.052095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.052375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.053041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:13.053344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.054712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.066039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 229/436] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:13.071937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.112442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.126161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 208/437] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15970-c335-4ad0-a75f-80bd8ee100e3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15970-c335-4ad0-a75f-80bd8ee100e3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15970-c335-4ad0-a75f-80bd8ee100e3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 209/438] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.136691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.137170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.159369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:13.161239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:13.195129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d303ca-4715-4922-9af9-1320c187a86e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.236176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.237757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.238263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.238749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.241391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 210/439] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:13.324920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.326601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.356647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.409604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.431770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 230/440] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:13.437067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.449479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.526611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f237-7478-4e02-baad-6b96265734ec None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.540694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddb5c7-8bb7-474c-8843-d36f0b6c4339 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.560779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.561410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.561693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.561968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.570282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.572642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:13.574695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.575317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.575594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.575869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.577000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:13.584728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:13.585767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 07:51:13.586788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:13.587535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.587622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 211/441] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:13.587622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.587770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 231/442] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:13.587770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.678691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.685210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc80843-70b3-4314-ae96-58872150ebc5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.694195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adf00-7be2-4af2-a31e-144057e3391c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.718659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.718820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.719258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.719356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.719534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.719646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.719804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.719892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.720483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:13.721358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.722769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.730549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 232/443] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:13.730764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:13.731318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:13.735556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:13.737284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:13.738106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 212/444] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:13.738771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.798248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.836518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425538d4-3f03-44f4-96f5-7a954cd6ba23 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.837271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257483-4c77-4798-ae2c-280281b127d8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:13.868372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.868976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.869255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.869530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.869978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:13.870597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:13.870877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:13.871143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:13.872262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.873683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.875225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 233/445] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:13.875971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:13.894459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:13.937085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:13.938489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:13.974143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdada8-50ad-41f7-81aa-0bf1543f8ce0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.001735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.007403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.008020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.008301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.008570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.009214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:14.009512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.010854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.019891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 234/446] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:14.020792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.037227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 213/447] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:14.038260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.092517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.118725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e65f60-fe08-4e01-b3ac-a61cdff31d21 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.137881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9dbb5-3bf1-4235-bd7a-1fa9b32a5595 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.152171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.152771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.153053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.153329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.154043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=c44a581892a64ee188bf77000a664f32) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:14.154357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.155793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.161559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 235/448] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=7cd14d5c176345a398d14136efaa152f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:14.162693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.171244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.171872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.172183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.172455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.248559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.256874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.262010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.308418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443542-3648-4ba4-9703-5f98285e4c9f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.323696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.351691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.353056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.353328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.354063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] PATH_INFO: `/v3/projects/c44a581892a64ee188bf77000a664f32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.355207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c44a581892a64ee188bf77000a664f32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.356662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.359140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 236/449] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/projects/c44a581892a64ee188bf77000a664f32 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:14.364941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.385595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 214/450] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:14.391195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.471752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1dac-f56e-46a7-ae92-62db8629a4b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.490395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd88b2-4943-43a7-9737-05981fdcd11d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.494726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.508074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.508074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.508074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.508074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] PATH_INFO: `/v3/groups/493ee2d8c55e488298ff6aa90199cd2d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.508427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] RBAC: Authorizing `identity:get_group(group_id=493ee2d8c55e488298ff6aa90199cd2d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.509112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.510818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 237/451] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/groups/493ee2d8c55e488298ff6aa90199cd2d => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:14.516600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.524407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.525041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.525320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.525594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] PATH_INFO: `/v3/projects/6e508fcc9dce499eae1e042c37e06fe3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.526709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] RBAC: Authorizing `identity:get_project(project_id=6e508fcc9dce499eae1e042c37e06fe3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.528163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.529762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 215/452] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/projects/6e508fcc9dce499eae1e042c37e06fe3 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:14.535342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.560847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.631621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4082-97b1-472c-9f91-93a05a7a6945 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.639055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5ab23-bee0-4be6-8180-061c87f45c91 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.666740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.667344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.667622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.667895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.668641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] RBAC: Adding query filter params (group.id=493ee2d8c55e488298ff6aa90199cd2d, role.id=b086728fbde044b28647906c294e9a64, scope.project.id=c44a581892a64ee188bf77000a664f32) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:14.668954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.670368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.673379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.674682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.675137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.675410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] PATH_INFO: `/v3/groups/47adc45045df4bf28ec42d58b9fee572` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.676567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] RBAC: Authorizing `identity:get_group(group_id=47adc45045df4bf28ec42d58b9fee572)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.677302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 238/453] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/role_assignments?group.id=493ee2d8c55e488298ff6aa90199cd2d&scope.project.id=c44a581892a64ee188bf77000a664f32&role.id=b086728fbde044b28647906c294e9a64 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:14.678080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce292fd-8fbe-4ee1-82f1-3ed25de61cf7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.679857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 216/454] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/groups/47adc45045df4bf28ec42d58b9fee572 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:14.685663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:14.746601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:14.791933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7822cdd-e560-4457-abcf-89cbdbca73ae None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:14.827051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:14.827670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:14.827951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:14.828252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:14.828988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] RBAC: Adding query filter params (group.id=47adc45045df4bf28ec42d58b9fee572, role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=6e508fcc9dce499eae1e042c37e06fe3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:14.829301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:14.831375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c8265-fb4c-41ce-a065-f6dfde64170e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:14.837740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 239/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Sep 13 07:51:14 2022] GET /identity/v3/role_assignments?group.id=47adc45045df4bf28ec42d58b9fee572&scope.project.id=6e508fcc9dce499eae1e042c37e06fe3&role.id=a902366353714eaeb9753ac3ce606c58 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:17.832871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19cbf-e387-4fa3-b59d-e55c6453e1a8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:17.833437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19cbf-e387-4fa3-b59d-e55c6453e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:17.833437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19cbf-e387-4fa3-b59d-e55c6453e1a8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:17.835167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 217/456] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:17.841426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3d72-13fb-4328-bed0-f932db67224a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:17.841941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3d72-13fb-4328-bed0-f932db67224a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:17.842013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3d72-13fb-4328-bed0-f932db67224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:17.865485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d71a3d72-13fb-4328-bed0-f932db67224a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:17.866717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d71a3d72-13fb-4328-bed0-f932db67224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:17.957104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 240/457] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:17.976541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3324c5-64c0-49b8-ab3b-916f069ace3b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:17.976854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3324c5-64c0-49b8-ab3b-916f069ace3b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:17.977096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3324c5-64c0-49b8-ab3b-916f069ace3b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:17.978788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 218/458] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:17.984623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e428a3-7318-40e7-b626-a52391cd1f72 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:17.984921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e428a3-7318-40e7-b626-a52391cd1f72 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:17.985182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e428a3-7318-40e7-b626-a52391cd1f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.016549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c1e428a3-7318-40e7-b626-a52391cd1f72 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:18.017790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c1e428a3-7318-40e7-b626-a52391cd1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:18.086010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:18.113959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 241/459] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:18.134943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659adc6-391f-403e-8516-6de489874762 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.135547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659adc6-391f-403e-8516-6de489874762 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.136062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659adc6-391f-403e-8516-6de489874762 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.137987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 219/460] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:18.149613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.149896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.150165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.179005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:18.180191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:18.268009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 242/461] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:18.315571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659adc6-391f-403e-8516-6de489874762 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.454684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:18.469204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659adc6-391f-403e-8516-6de489874762 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:18.474608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.511950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:18.512872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.513733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.514145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.526748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:18.528427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d8d2e3fb-7256-4da9-89f5-04a0727bae09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:18.549301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:18.550361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:18.551398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:18.551398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.551398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:18.553074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 220/462] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:18.554364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699790-d053-4e83-92fe-a588becd2c72 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.554786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699790-d053-4e83-92fe-a588becd2c72 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.555189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68699790-d053-4e83-92fe-a588becd2c72 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.556811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 221/463] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:18.558456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68699790-d053-4e83-92fe-a588becd2c72 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.620266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2d60d-6173-4929-8b7d-a040f418d8c0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:18.632883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:18.662995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:18.663633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.663911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.664213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.674601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:18.676081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9ef18a7c-2b07-4811-8a25-7ce209404b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:18.690698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:18.691620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:18.692507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:18.692507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.692507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:18.692507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 243/464] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:18.693025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.693312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.693580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.698141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68699790-d053-4e83-92fe-a588becd2c72 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:18.712378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:18.713585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:18.739905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:18.740847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.741143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.741395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.742031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:18.742338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:18.743718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:18.765425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 222/465] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:18.765425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.765425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:18.800420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 244/466] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:18.801291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.880522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e493-7a2d-4013-9464-fabb4df412a9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:18.910581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:18.921335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:18.922099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.922487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.922868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.924372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc28b7-e754-4389-81db-0484187c0b08 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:18.935444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:18.937176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:18.953900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:18.955013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:18.956206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:18.956206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:18.956206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:18.962293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 223/467] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:18.963372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:18.967155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:18.968600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:18.968884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:18.969160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:18.969806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:18.970110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:18.972138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:18.989160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 245/468] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:18.990213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.041175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.093554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca605c-ca5b-428d-a3b4-308050011f5e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.106764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e09b-aca5-4b0b-ad4e-8613fc4a8b5b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.131847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.132493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.132768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.133039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.133680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.135137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.143707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.144345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.144625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.144891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.145528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:19.145834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.147184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.159579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 246/469] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:19.160959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.176020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.210898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 224/470] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:18 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:19.211630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.267218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f41c8-fb57-49c3-9863-2dac2abb9217 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.307782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.308719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.309005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.309574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.311134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.312816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2ca8-9831-4374-afa6-b0806b1d1a88 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.342375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8634-01c2-4bd4-886a-86e95301c1c7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.353939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.376453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 247/471] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:19 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:19.378010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d834b-02e2-4fdd-bd2f-ff04d333382f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.383434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d834b-02e2-4fdd-bd2f-ff04d333382f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.383434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d834b-02e2-4fdd-bd2f-ff04d333382f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.383434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 248/472] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:19.383434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d834b-02e2-4fdd-bd2f-ff04d333382f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.387062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.387724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.388102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.388760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.408312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.409804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5a38ecd1-213e-4f7a-8a31-bba38ebe32cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:19.427046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:19.428052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:19.428905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:19.428905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:19.428905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:19.428905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 225/473] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:19.429829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.430108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.430380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.451296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:19.452490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:19.488862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.539125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d834b-02e2-4fdd-bd2f-ff04d333382f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.552160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 226/474] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:19.553047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.582300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.582917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.583745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.584046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.584702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.586369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.664903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.680101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 249/475] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:19 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:19.682583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645eea-ec97-4c59-bf88-b9e9c845a54e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.729343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.729970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.730244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.730511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.731158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:19.731456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.732921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.745834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 227/476] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:19.751317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:19.866599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d281e9-d12e-4eae-a554-a9d497e6ff5c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:19.896598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:19.902970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:19.903642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:19.903926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:19.904230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:19.904900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:19.906338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:19.911029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:20.039437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 250/477] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:19 2022] POST /identity/v3/users => generated 249 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:20.049882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d57e19-9f19-4dbb-b8fc-aeabe4906695 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:20.091057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:20.091678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:20.091953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:20.092265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:20.092957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:20.094335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:20.124356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.sql.core [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 07:51:20.124356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 07:51:20.124356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [parameters: {'id': '26273b3af01d4dd5ac082ff627904538', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 07:51:20.124356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81518) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Sep 13 07:51:20.150541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:51:20.151493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application yield resource Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise self.value Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application session.commit() Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 07:51:20.152994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.flush() Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application compat.raise_( Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 07:51:20.153869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:51:20.154726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:51:20.155559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [parameters: {'id': '26273b3af01d4dd5ac082ff627904538', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:20.156403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 07:51:20.157314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:20.158534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 228/478] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 07:51:19 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:20.165125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:20.317791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11505bd-9e80-4bc7-9268-801b34de419c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:20.354877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:20.355522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:20.355804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:20.356104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:20.367743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0279d588-1d6b-4e34-b952-d131370bf074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:20.373061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:20.375246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:20.377487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 251/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:51:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:20.385028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:20.407516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:20.492203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5af35-57a4-4cd2-8e3f-6f52e35008bf None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:20.531075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:20.531696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:20.531969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:20.532265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:20.533468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:20.533950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:20.535337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd0dea-5210-4303-8bd9-0aa37770bee0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:20.544569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 229/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:21.778530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741f39-07f0-471f-a5ea-1c124536bee3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:21.779232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741f39-07f0-471f-a5ea-1c124536bee3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:21.779232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741f39-07f0-471f-a5ea-1c124536bee3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:21.780654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 252/481] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:21.786185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1389e-d123-475d-8e2e-21c37787d3c2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:21.786675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1389e-d123-475d-8e2e-21c37787d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:21.786827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1389e-d123-475d-8e2e-21c37787d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:21.817000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-dca1389e-d123-475d-8e2e-21c37787d3c2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:21.818203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dca1389e-d123-475d-8e2e-21c37787d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:21.910559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 230/482] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:22.069475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e500-47ce-4f47-98e2-c44a9839be89 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.069740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e500-47ce-4f47-98e2-c44a9839be89 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.070010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e500-47ce-4f47-98e2-c44a9839be89 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.071330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 253/483] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:22.076804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.077086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.077359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.102417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:22.103587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:22.105615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:22.186507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 231/484] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:22.328168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e500-47ce-4f47-98e2-c44a9839be89 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:22.388589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:22.462951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e500-47ce-4f47-98e2-c44a9839be89 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:22.501063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:22.501914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.502204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.502536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.518821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ecc8ace8-6e92-473f-8d04-47fc854fb822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:22.524199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:22.526318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:22.528323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 254/485] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:22.536259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:22.564187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326ded-ed3b-4909-bceb-94bd66d48e67 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.564579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326ded-ed3b-4909-bceb-94bd66d48e67 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.564845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326ded-ed3b-4909-bceb-94bd66d48e67 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.566190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 255/486] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:22.569537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326ded-ed3b-4909-bceb-94bd66d48e67 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:22.656911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee754-59e0-44c3-9d90-b52cd2a1d74d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:22.686740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:22.694869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326ded-ed3b-4909-bceb-94bd66d48e67 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:22.702638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:22.703697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.704005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.704277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.705652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:22.705963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:22.707997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e87146-d5c9-4b75-8175-2574e2576fef None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:22.714991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:22.719554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 232/487] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:22.721436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.721774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.722059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.739731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:22.740671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.740948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.741211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:22.744479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:22.745675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:22.756407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:22.761614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:22.763735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:22.765790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:22.772010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 256/488] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:22.772010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:22.822291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 233/489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:22.823189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:22.922957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa713aa-c59f-49c6-834c-ef9bbba4f231 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:22.969131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2da64-ffef-460b-ad39-0abbfad54f44 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:22.988862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:22.989767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:22.990185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:22.990622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.002745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.004472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:23.022945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:23.023956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:23.024935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:23.024935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:23.024935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:23.026317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 257/490] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:23.034880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.061055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.072775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.082021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.084231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.084665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.085241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.087090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:23.088231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.090381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.108777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 234/491] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:23.113398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.183498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826650a3-3818-4fbd-bbe6-fa89741db707 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.219021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.220045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.221275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.221746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.222542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:23.223075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.224774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a13eb-0a2c-4d63-9e98-57391d43aeb2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.232160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79c22-705e-4248-b937-110843d02f7a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.242962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 258/492] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:23.242962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbacc-498e-4277-bab7-c209ba03a6f4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.242962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbacc-498e-4277-bab7-c209ba03a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.242962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbacc-498e-4277-bab7-c209ba03a6f4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.242962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 259/493] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:23.244898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbacc-498e-4277-bab7-c209ba03a6f4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.276051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.276947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.277238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.277782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.291919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.293941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:23.309882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:23.310830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:23.311681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:23.311681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:23.311681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:23.311681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 235/494] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:23.311906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.330950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.362036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbacc-498e-4277-bab7-c209ba03a6f4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.366190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.401194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.401854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.402197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.402507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.415806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-dbf8244d-f4d9-404f-83b5-5d9ae3328839 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:23.421392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:23.422523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:23.423309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 260/495] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:23.424324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.424324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.424445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.437802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309f08b-d2a4-420b-96f7-dd539a67f3be None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.444342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:23.445552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:23.478787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.479722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.480192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.480603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.490546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.492757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:23.509708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:23.510807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:23.511892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:23.513192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 236/496] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:23.513982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.519339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 261/497] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:23.520474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.582257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.621474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac754fa-d520-405c-a69c-255e8f24e8bd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.624547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.624654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bfd08-2e8d-4c85-a847-f0c4a52adf27 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.659661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.660302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.660584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.660858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.661497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:23.661792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.662697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.663429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.663660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.664139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.664574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.665538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:23.666414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.667923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027f92b-6431-4f1a-978a-4bb6323a96a9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.679958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 237/498] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:23.680169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 262/499] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:23.680169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4ac5-5c54-43ac-8f7c-bea7c3914636 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.680169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4ac5-5c54-43ac-8f7c-bea7c3914636 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.680169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4ac5-5c54-43ac-8f7c-bea7c3914636 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.680169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 263/500] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:23.680491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.684670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4ac5-5c54-43ac-8f7c-bea7c3914636 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.784950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd3c34-f18b-4005-9031-dd8bfcd48416 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.792805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4ac5-5c54-43ac-8f7c-bea7c3914636 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.816375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.820736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.821397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.821679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.821955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.822677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:23.823203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.824458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60adba1-d7a1-4ea7-b33e-8ac71c9395d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.826595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.827218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.827497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.827769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.835373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:23.836819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:23.849952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:23.851034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:23.851922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 264/501] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:23.852538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.860710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 238/502] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:23.862546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.862847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.863121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:23.880943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:23.882135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:23.898586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:23.952650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787b79f-bef2-4419-a783-13dd4e5c5c5c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:23.956462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 239/503] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:23.957482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:23.992951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:23.993578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:23.993856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:23.994131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.004658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.006107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:24.020482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:24.021565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:24.022567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:24.022567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.022567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:24.022567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 265/504] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:24.022794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.061846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.069172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef81a6-2115-44eb-97a1-141af3c70eee None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.103343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.104005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.104283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.104557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.115071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:24.119848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:24.120890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:24.121696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 240/505] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:24.122360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.136874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6ce5-c898-4423-8259-79298cb3a083 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.137897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.173017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.174578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.175102 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.175372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.176112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:24.176413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.177835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.218369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 266/506] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:24.218369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.243787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cbba4-4bc8-4a55-9ba9-a524e9fadc01 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.281855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.282457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.283447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.283750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.311420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.318013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28866bd2-d11a-4b1d-a207-09afb09d370f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.350410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.351030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.351678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.351882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.352026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.352247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.353181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:24.353776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.355595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.365336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.366639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 267/507] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:24.367422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.452150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 241/508] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:24.452992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.466766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc432c-a27b-46e2-a2d0-14a525e212f2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.500286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.500883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.501163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.501433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.502897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:24.503196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.504611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.512350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 268/509] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:24.513136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.530482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.554685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb414dc-72dd-4380-b082-cf30b3ac214c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.567895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.588314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.588847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.589124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.589394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.616211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a7f6-e578-4d84-b6a7-e69e9c97f543 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.650004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.650629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.650973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.651252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.659098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.660599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.661674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.663374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:24.678150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:24.679129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:24.679967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:24.679967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.679967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:24.679967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 269/510] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:24.680213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.748836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.766372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 242/511] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:24.767270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.782279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5166-9dca-46a6-9434-aa4128ae59a6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.784141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.816331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.816965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.817239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.817510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.826022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.827479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:24.838786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:24.839851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 270/512] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:24.841004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.874451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82711594-1b20-41d1-b145-ec0aae514e5b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.908401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.908898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.909179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.909453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.919690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.921184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:24.936074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:24.937159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:24.937997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:24.937997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:24.937997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:24.937997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 243/513] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:24.938350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:24.945837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e320a-58a0-4f19-9bd6-a38ef25d7873 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:24.972114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:24.979516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:24.980178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:24.980455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:24.980727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:24.991322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:24.992790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:24.998165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:25.007463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:25.009683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:25.010583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:25.010583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:25.010583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:25.010583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 271/514] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:25.010583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.036520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b04e1b-09f8-44e9-8cdd-f4369ffe9c1f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.069513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.070107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.070384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.070654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.071280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:25.071576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.072967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.084209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 244/515] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:25.084989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.113445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730de3d7-10f0-4a10-aa90-d0148d89492a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.146646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.147266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.147545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.147817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.158575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.160057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:25.174408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:25.175406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:25.176276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:25.176276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:25.176276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:25.176276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 272/516] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:25.176276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.187119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5341b-2aaa-4bef-a53d-2ee2b198887b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.209790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.211791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.222671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.223280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.234411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.234411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.234411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:25.234411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.234411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.243629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 245/517] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:25.244544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.282657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c63a4-d096-446b-a212-a150c3afbfca None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.315303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.315900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.316205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.316470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.317099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:25.317392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.318786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.330515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 273/518] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:25.331275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.350479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27afc1-d0ad-4a2b-8634-47a334bae722 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.383184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.383716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.384013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.384288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.384916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:25.385217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.386580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.398145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 246/519] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:25.398921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.427011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.435271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289ba61-4557-46a1-8766-2624a0261554 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.443759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.468810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.469403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.469677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.469953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.470632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.472177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.498794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edff7e-6bf1-4eab-b654-33141591a466 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.532114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.532902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.533204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.533474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.534097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:25.534481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.535833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.546609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 274/520] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:25 2022] POST /identity/v3/users => generated 247 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:25.552724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 247/521] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:25.552904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.552992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.668511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c9ea-c146-4af7-9bf6-198b8488bb9c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.668695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc521a4-0558-4c56-a748-63918a144fdb None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.670071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.706810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.707024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.707432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.707532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.707711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.707803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.708007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.708098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.715381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.716859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.728385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:25.730250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:25.731064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:25.731918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:25.732385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 248/522] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:25.733020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.788925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.790377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.855001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752120-b5ed-41e6-b73f-5f51bed0c477 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:25.890369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:25.891022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:25.891260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:25.891528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:25.896027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 275/523] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:25.896027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.903460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:25.904934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:25.917716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:25.920936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:25.922035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:25.923924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 249/524] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:25.924815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:25.948098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:25.950446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.001443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52a8-9185-4c7b-929c-8d8ac45907f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.028282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d362e-6a82-4842-b342-277aa30743fd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.036912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.037849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.038119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.038397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.045154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.046601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:26.059088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:26.059951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:26.060953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 276/525] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:26.061422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.069151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.069445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.069625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.069899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.070588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.070888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.072349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.095036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 250/526] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.095036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.175081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60d13-f090-4636-9b24-be7ae79ed47d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.181596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.184266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.205792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd01c9-64b6-4186-9109-ec5cb3ebee3d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.210127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.210754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.211030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.211296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.222410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.224019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:26.238920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:26.239895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:26.240771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:26.240771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:26.240771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:26.240771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 277/527] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:26.240771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.247208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.247825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.248135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.248408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.249139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.249441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.250890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.270694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 251/528] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.271541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.355056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0f2fd-256f-44d9-b907-f37a549f2e13 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.376346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a37eba-1617-445e-a30a-849d0bb40943 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.390587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.391188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.391465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.391726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.392535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.392833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.394249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.412770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.418099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 278/529] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.418219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.418219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.418219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.418425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.418507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.418507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.418507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.422132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 252/530] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.429124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.436454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.446571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.546048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcec42-ecf9-4c3d-8039-e80215b38eb7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.589159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052369-c90f-43b6-bd11-a9f8f4d8f324 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.591010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.591720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.592130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.592496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.593897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.593897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.594955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.612679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 279/531] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.614131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.649483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.651136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.651918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.652535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.731815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.740007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.741475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.745055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:26.759147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb2b5-21c3-4883-9a79-f1c16d575165 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:26.806205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:26.807880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:26.808688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:26.809336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:26.810958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=7ff9dd1806ea4e4bbc4036bfeaeb9856) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:26.811432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:26.813019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:26.821038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 280/532] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/role_assignments?user.id=7ff9dd1806ea4e4bbc4036bfeaeb9856&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:26.829080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:26.875288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 253/533] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:26.881536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.036887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7aab-3291-46bb-86c3-376810556467 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.042946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:27.063546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957e8dc-ceac-42b2-9c95-db2f197aa1a6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.100422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.101938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.101938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.102137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.115284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.115452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.116357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.116790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.117062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.117707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.128633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.130383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:27.143866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:27.144824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:27.145679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:27.145679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:27.145679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:27.147088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:27.147884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:27.148828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:27.153987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 254/534] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:27.155664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 281/535] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:27.160996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.162622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.173696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:27.364123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da514-013b-47db-8851-0b2e4ae86de0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.368730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac242de-adc4-447d-a841-a3d1ffbc4a27 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.434538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.435512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.436379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.437190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.437691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.438158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.438709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.440507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:27.441014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.441851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:27.442370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.443945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.444533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.446191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.468584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 255/536] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:27.475865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.477215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 282/537] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:27.482498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.509609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:27.606134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:27.665586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b26b2-303b-4c14-9b7e-b083b443a6f6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.680018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1139-5f00-494b-a5ba-184215f8e042 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.743258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.743921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.744226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.745133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.746317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.746940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.747210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.747475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.748245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=840b8207e53043a8bab349f03f6ac109) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:27.748553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.750047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.760134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.761620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.771360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 283/538] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:27 2022] GET /identity/v3/role_assignments?user.id=840b8207e53043a8bab349f03f6ac109&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5678f716-1db5-4660-9342-c5e608dbb6b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:27.781767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:27.782726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:27.783594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 256/539] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:27.789747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:27.899674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a78f5-6921-4546-81b7-33d4bb53d0e8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.900047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a78f5-6921-4546-81b7-33d4bb53d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.900252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a78f5-6921-4546-81b7-33d4bb53d0e8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.902163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 257/540] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:27.907941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.908643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.909122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.940471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b816-8dc6-44cc-b99c-0a8702817759 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:27.944784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:27.946306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:27.969434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:27.978430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824194-773e-493f-9d98-32f444060087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:27.979047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824194-773e-493f-9d98-32f444060087 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:27.979326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824194-773e-493f-9d98-32f444060087 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:27.979644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824194-773e-493f-9d98-32f444060087 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:27.980427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824194-773e-493f-9d98-32f444060087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:27.980732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824194-773e-493f-9d98-32f444060087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:27.982219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824194-773e-493f-9d98-32f444060087 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:27.996376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 284/541] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:28.004667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824194-773e-493f-9d98-32f444060087 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:28.084104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 258/542] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:28.139791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824194-773e-493f-9d98-32f444060087 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:28.191762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:28.192322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:28.192601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:28.192874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:28.193585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=79a68e7eaa644d2aa9616ba1dde8fd95) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:28.193888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:28.195296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:28.201538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 285/543] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:28 2022] GET /identity/v3/role_assignments?user.id=79a68e7eaa644d2aa9616ba1dde8fd95&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:28.442694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:28.451497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:28.549321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfec81-bddb-46ab-8e3b-a10043c3df9e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:28.584882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:28.585859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:28.586376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:28.586848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:28.601618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:28.606753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:28.607640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:28.608479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:28.617149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 259/544] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:28.621781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:28.715860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:28.780456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8960e61-784d-46a5-b041-989daa2e90ab None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:28.828750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:28.829388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:28.829755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:28.830037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:28.830707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:28.831013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:28.832437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bf39c-b918-48ce-8735-6e8afc1db84e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:28.841404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 286/545] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:28.848140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:28.874535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768db371-cd8f-4ec7-8260-7117b83dda4d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:28.874957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768db371-cd8f-4ec7-8260-7117b83dda4d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:28.875081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768db371-cd8f-4ec7-8260-7117b83dda4d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:28.877225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 287/546] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:28.885127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:28.885414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:28.885687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:28.918572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:28.920657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:28.976469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:29.045529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0d222-f4d7-44ac-b853-e6e72b9b0590 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.046619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 288/547] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:29.103280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:29.103947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.104264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.104540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.115640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:29.117337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:29.132325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:29.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:29.135626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:29.135626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:29.135626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:29.135626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 260/548] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:29.141840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.215623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:29.290159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8243-5a14-484d-b140-9b3ef289621b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.338241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:29.338861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.339146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.339421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.340090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:29.340393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:29.341775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:29.357127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 289/549] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:29.362857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.411658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.547553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb2fed-7e57-4c65-b93f-864b790f790a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.569454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:29.578805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaa462-f6fa-4b9f-bc10-ae0774edfa68 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.581372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:29.591226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:29.595807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.595807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.595807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.603575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:29.605237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:29.620758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:29.621443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.621762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.628332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4b477114-2af7-4784-8891-c53aac831651 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:29.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:29.629302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 261/550] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:29.630217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee0dd9-f886-4ee6-8bb2-cf3b34276f82 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.631328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee0dd9-f886-4ee6-8bb2-cf3b34276f82 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.631761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee0dd9-f886-4ee6-8bb2-cf3b34276f82 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.633826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 262/551] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:29.638000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee0dd9-f886-4ee6-8bb2-cf3b34276f82 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.639037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f0da163d-5f9c-4c19-9da9-d0581820608c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:29.644038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:29.645032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:29.645840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 290/552] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:29.646998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.647093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.647351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.666841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:29.668158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:29.760328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 291/553] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:29.760328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.781532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee0dd9-f886-4ee6-8bb2-cf3b34276f82 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.845237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:29.846964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:29.847248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:29.847521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:29.849781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:29.850098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:29.853726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:29.891164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 263/554] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:29.896639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:29.954017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:29.970796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fc6dc-528b-4a4d-9a00-c9b58e16a2e0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:29.977059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.075638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af769-952f-430f-8c10-6218d1771740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.076939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af769-952f-430f-8c10-6218d1771740 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.077221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af769-952f-430f-8c10-6218d1771740 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.077498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af769-952f-430f-8c10-6218d1771740 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.078161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242af769-952f-430f-8c10-6218d1771740 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:30.078472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242af769-952f-430f-8c10-6218d1771740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.086031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242af769-952f-430f-8c10-6218d1771740 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.089545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde566-daad-4953-ac96-7de567072fb8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.096886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 292/555] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:30.098224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af769-952f-430f-8c10-6218d1771740 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.128063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.129496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.130074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.130546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.207381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.209373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.222582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af769-952f-430f-8c10-6218d1771740 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.250646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.285592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.286795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.287496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.287920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.302366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:30.308698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:30.309792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:30.310618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:30.313511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 293/556] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:30.314890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.340995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.355873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 264/557] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:30.357564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.442684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4063-80cd-41a0-b3a8-89498eb343c4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.480705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.480985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25163de-9368-4bc6-bd42-21d604692200 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.481445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.481938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.482087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.492659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.493985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:30.508923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:30.509857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:30.510741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:30.510741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.510741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:30.510741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 294/558] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:30.510741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.524054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.524670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.524949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.525224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.525883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:30.526923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.528334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc89757-2da7-4d9d-a0e3-8cab17bf8b27 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.530609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.542128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 265/559] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:30.542128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec21bd-995a-4026-8aa9-53947c89132f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.542128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec21bd-995a-4026-8aa9-53947c89132f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.542128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec21bd-995a-4026-8aa9-53947c89132f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.542128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 266/560] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:30.549484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec21bd-995a-4026-8aa9-53947c89132f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.590372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.640624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902771a-bb6c-4358-b272-65156183a789 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.660226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec21bd-995a-4026-8aa9-53947c89132f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.686116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.687086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.687578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.688048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.695867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.696501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.696782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.697053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.698096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:30.698413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.699782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.703104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.704785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.711998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 267/561] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:30.712933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d046bcfb-dad1-4be1-8c47-09b78db70476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:30.726715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:30.727700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 295/562] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.733691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.749340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:30.750517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:30.779483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.817376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 296/563] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:30.818220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.819080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac600-7174-44a7-bc81-ab47e004b7c4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.853984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.854614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.854892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.855165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.866517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.868003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:30.883023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:30.888943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:30.889911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:30.889911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:30.889911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:30.889911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 268/564] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:30.889911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:30.893540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:30.951405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52330d-b8e2-4472-b70f-94d4db288d79 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:30.986535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:30.987167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:30.987440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:30.987705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:30.994786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:30.996354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f73fc140-3b0c-45fc-a78a-df1e5e30c75d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:31.007950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.008926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:31.009853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 297/565] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.010458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0ea6-ba61-4304-b5ea-79a51d06f57f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.010458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0ea6-ba61-4304-b5ea-79a51d06f57f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.010917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0ea6-ba61-4304-b5ea-79a51d06f57f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.015711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 298/566] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:31.015711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0ea6-ba61-4304-b5ea-79a51d06f57f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.018220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82d7a-21a2-4f07-a8f6-378e40f44f2c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.029859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.056522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.057247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.057527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.057800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.058613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:31.058918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.060589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.075349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 269/567] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:31.076193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.124326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0ea6-ba61-4304-b5ea-79a51d06f57f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.134730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.158907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.159840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.160384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.160874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.162281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:31.162832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.165504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ccb9c-96af-4fdb-b7ac-c3a577998fd7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.173173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce3f6-c6ff-4d25-add3-ea097d1f9d25 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.177669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 299/568] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:31.178912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.179198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.179471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.200697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:31.201933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:31.211443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.212087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.212372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.212646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.213377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:31.213744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.215182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.241574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 270/569] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:31.241574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.269951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.275607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 300/570] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:31.276401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.359556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c27189-6d45-4d3e-a27a-9d2b1e70a07d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.402572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.403243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.403952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.404280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.414716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.416901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.418066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82201a-7635-4dcb-8547-fc4f9e5f8cde None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.418358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:31.430962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.431917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:31.437902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 271/571] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.438649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.460766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.462260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.462776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.463049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.478176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:31.482813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.483892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:31.484921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:31.489353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 301/572] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.490316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.547072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.560818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b020965-0b04-4a3c-9441-12b7800e5371 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.598165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.598815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.599089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.599357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.607495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.609063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.622272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2019a-dd1a-4a61-be0b-f47e97e0918d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:31.622456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.623434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:31.624449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:31.628324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 272/573] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.629238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.666003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.666553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.667022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.667134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.678774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.680254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:31.695256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.696418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:31.697331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:31.697331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:31.697331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:31.697331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 302/574] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.697331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.716276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.754444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55543c-e0fd-4281-9025-6bf79650b607 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.790409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.791023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.791300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.791571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.792286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:31.792586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.794012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.812903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 273/575] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:31.813742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.821101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399d06-62d8-4bb7-b975-2d632f187f0e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.824949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.863957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.864600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.864887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.865156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.865806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:31.866119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:31.868176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:31.880058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 303/576] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:31.880898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:31.931839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b9f3-ee76-4dc1-b5be-468f6297a35b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:31.972194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:31.973128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:31.973403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:31.973673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:31.976701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:31.985327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:31.992436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:31.994358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 274/577] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:31.998820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.006997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9377d-6a54-4bb5-9aa3-875da5c9bb30 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.045858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.046502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.046781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.047052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.047775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.048666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.050133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.074894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 304/578] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.075742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.082929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.126241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a1f7-5f0b-4a69-bf48-7bbd38521417 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.173122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.174529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.174773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.175027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.175679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.176803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.177395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.183489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db44fa-348f-40ec-904f-94b275e18f42 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.197163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 275/579] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.197163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.214119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.218942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.219684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.220074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.220526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.221243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=085da9bf0ef94bf89f7254dd67301a76) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.222355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.223542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.230065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 305/580] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/role_assignments?user.id=085da9bf0ef94bf89f7254dd67301a76&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.230904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.342649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b752ca4-c6da-4f56-8dbf-72e7d8f2e8d6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.370789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9078717-9910-491f-8c70-8adf585c3aaf None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.375140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.385336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.391331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.391331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.391331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.399685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.401196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.410017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.410914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.411375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.411840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.412796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.413101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:32.418965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:32.419875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:32.420780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:32.420780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.420780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:32.420780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 276/581] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:32.421428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.425682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.439764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 306/582] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.439764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.503027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.538230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a9392-62e6-49e3-baf1-fbadd47622e1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.548171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7a808-da6e-4c8c-948d-1967be508a1c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.576370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.577077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.577313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.577585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.584954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.585589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.585868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.586142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.589361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.590897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.593041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.594524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:32.606427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:32.607611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:32.608713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:32.608713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.608713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:32.608713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 277/583] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:32.609556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:32.618619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:32.619558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:32.621550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:32.624419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 307/584] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:32.626354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.646608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.720574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0f3b-96f5-4d62-874c-b486c7e176d8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.752792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651835fa-e4db-42e1-93bb-e8ab0866dda7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.755052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.755657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.755936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.756233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.756865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.757164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.758514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.772244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.776473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 278/585] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.777981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.789884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.790611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.790972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.791336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.802472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.804314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:32.819884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:32.820905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:32.821827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:32.821827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:32.821827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:32.821827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 308/586] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:32.821827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.874961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:32.883766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03cbe8-96bb-4bab-b1b0-1e2e2ffd3167 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.918676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.919277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.919560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.919829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.920488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.920790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.922148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.933932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 279/587] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.934729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:32.945610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67871610-44d5-462c-adb1-eb70eb07e56c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:32.981148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:32.981689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:32.981963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:32.982236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:32.982919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:32.983222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:32.984690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:32.997919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 309/588] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:32.998549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.031302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.056032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c4a3-8572-43a5-9056-e22ff42e5fdd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.093085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.093716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.093997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.094476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.103142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.104625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.110577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec0b53-1e0d-4bad-9950-31cfbf14c8e1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:33.116415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:33.117366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:33.118382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:33.122165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 280/589] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:33.122996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.139068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.149353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.158342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.170361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 310/590] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:33.170361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.233592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510956c-18a0-46fa-b404-ea3834156459 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.268015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.281129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.281876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.282261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.283058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.284644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d272c7-bd75-4fff-b3fc-d691d7c58346 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.290457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.291903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:33.304931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:33.305815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 281/591] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:33.312017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.326513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.327268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.327625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.327986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.343453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=5f3b6c53dcc844c784c17f6c4af76bfb, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.345019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.382190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.410905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 311/592] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:33 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:33.411775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.413282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3c2d7-0722-4994-acbb-9b7429ed0228 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.461513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.462208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.462495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.462768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.463562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:33.463873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.465545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.491906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 282/593] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:33.493289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.552857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5e12-cea3-4c6e-8c14-5ce63c189f31 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.596860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.597515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.597791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.598060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.607411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.608849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.613031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:33.623287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:33.624322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:33.625281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 312/594] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:33.626497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.634931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840bb54-7bd9-4184-ac20-58584c19c5f6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.672114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.681970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.682597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.683300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.683584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.684659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:33.690171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.690171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.704988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 283/595] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:33.705947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.750565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b354-8b18-4abb-8ef1-110d2859001a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.790271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.790937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.791212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.791657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.804197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.805625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:33.821450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:33.822429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:33.823319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:33.823319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:33.823319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:33.827843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 313/596] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:33.828511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.837258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c822-3cd0-4bf1-a5c7-ca1eb6d1e4c4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:33.874962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:33.875953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:33.877033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:33.877501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:33.878416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:33.878916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:33.880606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:33.893445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.899683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 284/597] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:33.900858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:33.967679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:33.986773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade486-ab04-4280-b964-937b7340d698 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.023799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6485-002e-4b4e-a0af-cb7e0c1ed991 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.030360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.031027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.031304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.032047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/7ff9dd1806ea4e4bbc4036bfeaeb9856/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.052700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=7ff9dd1806ea4e4bbc4036bfeaeb9856, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.054559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.060460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.061086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.061347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.061615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.062248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:34.062550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.064509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.076691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 285/598] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:34.077315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.128702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 314/599] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:33 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/7ff9dd1806ea4e4bbc4036bfeaeb9856/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:34.131318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.243169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d2ee-cade-4b47-ae90-8de73538feb2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.255082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:34.295925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.296604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.296882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.297149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.322682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.326831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:34.356413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:34.357402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:34.358288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:34.358288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:34.358288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:34.358951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 286/600] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:34.361931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00adcd-a1bb-42c2-a8d3-b3c1ae16be16 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.363600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:34.366406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.411762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.412755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.413001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.413754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.424177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.425763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:34.441049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:34.443240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:34.445446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 315/601] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:34.449360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.508697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266ef9-a5df-4225-8536-b7d957c761ee None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.546627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.547506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.547785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.548082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.549425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:34.550017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.551454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fc21-349e-4455-981d-af43afeb6e04 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.564244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48197b8-9538-4522-98c9-7ef9aeb3e069 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.567928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 287/602] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:34.569208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f3a8-d714-4dcb-b466-ea6998dff00e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.569495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f3a8-d714-4dcb-b466-ea6998dff00e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.569768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f3a8-d714-4dcb-b466-ea6998dff00e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.571210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 288/603] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:34.572984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f3a8-d714-4dcb-b466-ea6998dff00e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.601988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:34.607713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.608529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.608955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.609372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.610399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:34.610919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.613268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479099-9b73-4e87-b6ec-7f375a7f9d02 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.626867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 316/604] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:34.628583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.629407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.629964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.651736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:34.654386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:34.677837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:34.685530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f3a8-d714-4dcb-b466-ea6998dff00e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.724656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.725689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.726049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.726462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.734093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.735906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.744094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 317/605] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:34.745068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:34.756140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:34.757140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:34.758024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:34.758455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 289/606] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:34.763256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:34.869623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068afa-5acd-437d-ab4e-b4d3e4225999 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.891812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:34.905104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.905901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.906289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.906625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/840b8207e53043a8bab349f03f6ac109/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.914778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122d8-c8a8-4ecd-9932-8e8aeac51831 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:34.922719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=840b8207e53043a8bab349f03f6ac109, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.924771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.956318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:34.957278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:34.957734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:34.958207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:34.959073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:34.959629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:34.961318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:34.975068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 290/607] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:34.980748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:35.026562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 318/608] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:34 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/840b8207e53043a8bab349f03f6ac109/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:35.097128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f4d-c282-4e49-91ac-aac7e2b60b84 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:35.147891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:35.148528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:35.148810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:35.149089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/79a68e7eaa644d2aa9616ba1dde8fd95/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:35.169990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:35.176336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=79a68e7eaa644d2aa9616ba1dde8fd95, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:35.183047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:35.234821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:35.238351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:35.298939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 291/609] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:34 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/79a68e7eaa644d2aa9616ba1dde8fd95/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:51:35.364148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e583b-5a28-4b22-942a-4fdf9de6a5ff None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:35.402981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:35.404072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:35.404561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:35.405058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:35.418301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:35.424211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:35.425184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:35.426009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:35.433660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 319/610] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:35.435437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:35.547221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63c-77d1-455a-a5cb-8039299e9fa0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:35.598607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:35.599588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:35.600100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:35.600693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:35.601576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:35.602125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:35.603693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:35.619181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 292/611] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:35.625092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:35.705965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:35.749292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6084c-89c7-476d-8922-2612425a114c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:35.785844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:35.786503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:35.786782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:35.787316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:35.799662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:35.801168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-6e110b83-b94d-4fd3-a39d-178fa5548455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:35.826559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:35.827561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:35.829116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:35.829116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:35.829116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:35.829116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 320/612] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:35.834434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:35.918541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:35.984314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f637-6d6c-46fa-80eb-0d30c302d809 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.036063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.036681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.036962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.037497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.038144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:36.038451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:36.039824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:36.059366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 293/613] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:36.065379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fb5-5de4-4ba1-b214-e3209c785234 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.065670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fb5-5de4-4ba1-b214-e3209c785234 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.065950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fb5-5de4-4ba1-b214-e3209c785234 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.067285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 321/614] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:36.068310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.085293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.085570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.085847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.106055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:36.107270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:36.184106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 322/615] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:36.236413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267bcef-c542-4e47-ab33-704ee2998893 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.257323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:36.296163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.296866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.297519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.297820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.305732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:36.307168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:36.324072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:36.325026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:36.325999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 294/616] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:36.332703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.396176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:36.464634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d8e2-04f4-4e39-8f31-0534356ddd8e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.500807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.501509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.501796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.502070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.502796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:36.503108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:36.504568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:36.523353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 323/617] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:36.529064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.598993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.699068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f70e-36af-4ab2-9b88-c579c83ad4c0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.741817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.742745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.743030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.743302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.744104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c65ca-2998-4011-bf23-32770653c6db None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.745854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:36.759149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:36.759149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2852efd7-eb1c-4802-9c1b-24b223e315b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:36.780068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:36.781237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:36.782151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:36.782151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:36.782151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:36.782431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.782431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.782642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 295/618] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:36.782720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.782720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.782858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab01-7bbe-4219-8cd1-c539dc60429d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.782975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab01-7bbe-4219-8cd1-c539dc60429d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.783444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaab01-7bbe-4219-8cd1-c539dc60429d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.792192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 296/619] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:36.792192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaab01-7bbe-4219-8cd1-c539dc60429d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.804722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f3679d6f-46c3-488b-b55c-a25f505d597d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:36.810373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:36.811290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:36.812149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:36.816685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 324/620] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:36.818035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.818324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.818757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.828524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:36.839475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:36.840766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:36.908709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaab01-7bbe-4219-8cd1-c539dc60429d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:36.920180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 325/621] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:36.921099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:36.978154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:36.978774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:36.979054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:36.979326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:36.979993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:36.980538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:36.981923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.009065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 297/622] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:37.016660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.125305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.126071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.146791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05545-662a-4517-80f7-6f875afc6f42 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.149162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68788b25-0e68-4cc3-adaa-e58beee28380 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.202350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.203435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.203860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.204177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.212639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.214472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.221948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.222558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.222832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.223100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.223755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:37.224079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.225436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:37.227304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:37.228206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:37.229089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 298/623] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:37.235108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.246355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 326/624] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:37.263044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.365569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb8a4c-e775-40a8-bb3f-5ed49b90e85e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.378893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b12e8-0fdb-48a6-bdde-4525e39d285c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.404160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.405121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.405649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.406219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.407101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:37.407661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.409445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.415352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.415994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.416296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.416568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.423958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 299/625] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:37.425039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.433158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.436722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.438337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:37.456621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:37.469219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:37.470983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:37.470983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:37.470983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:37.470983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 327/626] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:37.470983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.473627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.552466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9184ad-186b-49d3-9c42-d8827fe282c4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.597343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.598353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bcc9-7c30-420b-bdfc-9186b79d6708 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.598793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.599310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.599805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.612191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:37.618004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:37.619033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:37.619901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:37.628006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 300/627] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:37.629245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.639908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.640618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.640899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.641180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/085da9bf0ef94bf89f7254dd67301a76/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.662497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=085da9bf0ef94bf89f7254dd67301a76, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.664263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.698409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.735721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 328/628] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:37 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/085da9bf0ef94bf89f7254dd67301a76/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:37.736143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33233eb-b45b-4c09-945f-e4b0f11f4191 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.737267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.776581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.777234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.777516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.777790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.778617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:37.778931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.780544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135276-0923-473a-ab13-6caea50cd73d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.802552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 301/629] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:37.804080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc36d4-37ed-4340-83b1-56700a4b0a08 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.804368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc36d4-37ed-4340-83b1-56700a4b0a08 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.804642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc36d4-37ed-4340-83b1-56700a4b0a08 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.806429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 302/630] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:37.807187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc36d4-37ed-4340-83b1-56700a4b0a08 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:37.817820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:37.873592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d311ac-77e9-4c52-aafa-aa9bb7d797b7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.924963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:37.926257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.926927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.927439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.928467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:37.929037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:37.931618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8960d5-fa6b-4d69-8bed-430875e2d3e0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:37.940063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc36d4-37ed-4340-83b1-56700a4b0a08 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:37.945131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 329/631] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:37.946682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:37.947280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:37.947766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:37.970337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:37.971594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:37.979486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.005127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.006773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.007493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.007966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.019271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.021626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:38.040298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:38.041518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:38.042685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:38.045785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 303/632] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:38.046822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.049957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 330/633] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:38.057083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.133404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.168531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076563cb-8548-4d01-a7bc-44da5b650198 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.200358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85f5b-de3e-4290-a338-b5da02d6ef16 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.205000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.205878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.206346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.206796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.218025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.219780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-d644fc04-6c1d-40ed-8360-2ca9a873c888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:38.235214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:38.236786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:38.237696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:38.237696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:38.237696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:38.239380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 304/634] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:38.241204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378334-c6a5-4b08-b211-88b60d26ec91 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.241696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378334-c6a5-4b08-b211-88b60d26ec91 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.241810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.242270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0378334-c6a5-4b08-b211-88b60d26ec91 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.242383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.242650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.242928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.243873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:38.244216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.244612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 305/635] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:38.245541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378334-c6a5-4b08-b211-88b60d26ec91 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.250224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac146d-802a-45a0-908e-e96ce7d5bbd5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.274023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 331/636] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:38.276189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.276593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.276883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.288349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.301851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:38.304007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:38.361366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0378334-c6a5-4b08-b211-88b60d26ec91 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.383642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 332/637] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:38.384702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.406533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.407321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.407750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.408112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.408874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:38.409240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.411015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.424904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 306/638] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:38.425863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.427820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.512508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa075f1-ae5a-4805-8fbb-16db46a26227 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.534689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.541725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257175e-aca7-48b4-bd28-31a10825023c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.560800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.561526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.561915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.562252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.578951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.580133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.580853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.581705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.592771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:38.598858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:38.599822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:38.600809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:38.603592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 307/639] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:38.604686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.654199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.656045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.697268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.726604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aeb02-0a11-434d-b5a8-a2ef1bc52fab None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.763745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.764424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.764734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.765005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.770806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 333/640] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:38.771869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.776490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.778020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:38.791826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:38.792858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 308/641] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:38.793819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.815463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.892666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6794ec-2730-4475-ba08-847dcce6a116 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.900826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec417f6-fa1f-4edd-b21d-3711bba788fc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:38.933461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.934003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.934266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.934606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.935248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:38.935545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:38.937016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:38.937956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:38.939290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:38.939741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:38.940085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:38.940432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:38.946640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 334/642] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:38.950664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:38.952233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:38.956053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:38.957315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 309/643] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:38.958167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.039302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.063043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf267d6-2237-4f74-9f6d-f0e9064393cc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.071425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be59f4e-f47d-47ce-8e06-45533c498673 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.100317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.100859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.101138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.101408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.102124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:39.102429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.103863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.107317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.107941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.108251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.108523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.119343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.120824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.125916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 310/644] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:39.125916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:39.139899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:39.140886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:39.142050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:39.142050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.142050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:39.142050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 335/645] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:39.142050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.195970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.235688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855cba7-239b-4f78-be5d-f2e498a2ea3f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.249297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28048c5e-66eb-42af-9e77-593e14dcc7e3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.273572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.275143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.275612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.276161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.278688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.286200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.287338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.287622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.287892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.288584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:39.288885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.290244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.291264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.293048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.299789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 336/646] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:39.300755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:39.309752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:39.310670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:39.311566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:39.311566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.311566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:39.312921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 311/647] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:39.314370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.417989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e529-2ed7-4c50-aaf8-2a718190923d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.420345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc663cc-2ab5-4531-ba44-c744bcfe6cde None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.431499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.455589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.456163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.456441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.456621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.456739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.457231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.457459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.457773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.458406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:39.458749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.460675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.476691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 312/648] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:39.476691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.523246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.533879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.535376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.580097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08213406-b294-4d9c-a60c-257a00e27c69 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.616524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.617153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.617431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.617699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.628104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.629539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:39.644787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:39.645740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:39.646635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:39.646635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:39.646635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:39.646635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 313/649] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:39.646884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.655841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 337/650] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:39.656704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.672761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.757451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.761315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2c9ab-e003-45ba-bb92-3824d9ae7ab5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.761576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfa7f-edac-4461-ad16-a57a7ff96abc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.798785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.798988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.799418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.799520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.799709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.799804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.800049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.800161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.800690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:39.800992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.802547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.806870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.808319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.815553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 314/651] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:39.816384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:39.821024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:39.821937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:39.822849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:39.823545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 338/652] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:39.828623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.899031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:39.924003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a731b-2dd1-46fe-baba-9ec5c1389c8c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.931131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec97f0-3d16-4042-9904-97fdaf139b73 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:39.963462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.964180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.964463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.964738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.965382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:39.965686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.967053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:39.971460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:39.972117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:39.972396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:39.972667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:39.979605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 315/653] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:39.981499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:39.984698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:39.987495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:40.002259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:40.003279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:40.009143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:40.009143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:40.009143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:40.009143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 339/654] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:40.009143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.012338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.096146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc928f7-6253-4cc0-ae74-29796d70e7a3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.109916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cdc9c-3625-4bf0-a72d-1a4ef612e08c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.128975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.129609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.129891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.130168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.133026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.137564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.139007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.143747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.145497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.145497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.145497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.145761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.145939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.147304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:40.150780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:40.151870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:40.152859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 316/655] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:40.153484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.160142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 340/656] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.160967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.232984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.254915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6d9e-8f40-4dfb-90b9-9d2330865f80 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.263513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc97168-ebb5-4efa-a7fe-2f64aa3ef7e3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.291908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.292565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.292845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.293118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.294673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.295279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.295554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.295829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.296497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.296791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.298671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c3c9f-c8fd-4a23-bd76-52925ab6470c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.301407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.302816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.310190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 341/657] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.311377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee491-2c8c-4416-be1b-cb15eec402b5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.311665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee491-2c8c-4416-be1b-cb15eec402b5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.311943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee491-2c8c-4416-be1b-cb15eec402b5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.318377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 342/658] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:40.318523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:40.319585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 07:51:40.320908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:40.321451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee491-2c8c-4416-be1b-cb15eec402b5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.321531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 317/659] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:40.321531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.364852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.414703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18949-06f3-401e-8943-fe75c40504f8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.420172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee491-2c8c-4416-be1b-cb15eec402b5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.448324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.448939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.449216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.449489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.450203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.450512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.451934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.454409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.455023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.455301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.455577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.456324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.456632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.457805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 318/660] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.458046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc0b44-fdee-4be9-ac14-433e53f4c9df None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.458580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.461875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.478404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 343/661] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.479860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.480281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.480654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.500785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:40.502773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:40.578366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 344/662] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:40.579909 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.594305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5f4cd-1287-4ca1-affa-02c4cf83afc2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.613754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.645893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.646599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.646887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.647319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.654548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.656207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:40.670901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:40.671886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 319/663] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:40.672842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.706284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e7090-1b34-4ff6-b3f0-a8842192ad70 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.758293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.759558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.759842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.762477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.762477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.762477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.762743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.762933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.787738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 345/664] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.788609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.811330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838ee1-4395-460e-93ff-89a448ee10a8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.849344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.850320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.856013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.856013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.901682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:40.912429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b6dee-6621-49ff-8b9f-66d67c91ee6d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:40.927517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.929057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.953672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:40.954623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:40.955110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:40.955613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:40.956685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:40.957170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:40.959013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:40.976549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 346/665] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:40.977503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:40.989007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.032257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 320/666] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:41.032257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.094189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393251-03bc-4cb4-a739-19492776a629 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.127782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef8e8f-2977-40c3-b913-1693f4472ae1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.131198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.131807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.132112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.132387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.152516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.162633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.163259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.163535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.163817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.174471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:41.179173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:41.180119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:41.180964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 321/667] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:41.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.211268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.212015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.212800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.297787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea50e8-164f-4216-877b-57ad5ff4529b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.324408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 347/668] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:41.325333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.338701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.339687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.340110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.340390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.341448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=7ff9dd1806ea4e4bbc4036bfeaeb9856) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:41.341762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.343366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.349984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 322/669] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/role_assignments?user.id=7ff9dd1806ea4e4bbc4036bfeaeb9856&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:41.350859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.397151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.458230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.477308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b1bc-4278-46e6-bd60-9732876bf031 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.477556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298ce9-2c15-4da8-8126-020db8cdc729 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.520106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.520736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.521018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.521293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.522071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:41.522384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.523911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.528677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.530044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.530529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.531104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.534644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 323/670] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:41.535698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.548732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.550462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:41.566405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:41.567378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:41.568307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:41.568307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.568307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:41.568307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 348/671] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:41.568530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.666057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa8ea-aa6b-4cf4-bcd7-27da353e2fb7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.693378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ec76-101f-43db-8e2d-b1bf8fbfa124 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.695652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.706342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.707053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.709475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.709475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.721173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.722664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.731464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:41.736963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.738586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.738586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.738586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:41.740489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:41.741504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:41.742393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:41.742393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.742393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:41.742393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 324/672] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:41.743031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.750974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.753012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:41.767708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:41.769987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:41.771234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:41.771234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:41.771234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:41.771234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 349/673] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:41.771234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.877771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8403c-5d16-4c4e-ba34-7565dcd86d43 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.882628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94aa6-c993-412e-9f10-fa42dd0e5205 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:41.922528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.923735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.924073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:41.924350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.924720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.925174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:41.925543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:41.925747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:41.926019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.926413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:41.927189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:41.927634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:41.927744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.929397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:41.942420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 350/674] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:41.942770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 325/675] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:41.943650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.948376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:41.963635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.027346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.060365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8e24-1ebd-4036-861d-71b1f8257999 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.088961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a960d-5c69-4a26-acbc-328ae60b2281 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.099257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.099871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.100196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.100471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.101109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.101412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.102768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.119958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 351/676] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.120853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.134539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.136009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.136611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.137079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.146748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.149151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:42.166531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:42.167453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:42.168358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 326/677] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:42.168879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.213977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.243573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb94a0f-d76c-44e6-8a71-171f5f054282 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.286920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.288266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.288743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.289241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.297108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.298997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.300656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02b6f-09c2-4d7f-997f-0e1d84f01e6e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:42.311435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:42.312391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:42.313345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:42.316715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 352/678] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:42.317724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.323693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.342453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.343099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.343386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.343663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.354718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.357017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:42.373601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:42.374630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:42.375583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:42.380047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 327/679] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:42.381119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.441479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb168a-6631-49ea-84b2-1b3611fd9eb4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.483099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.484416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.484416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.484613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.485999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.486465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.488272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.490183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.503880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 353/680] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.505016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.526740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210771e-4363-4cd2-acd6-fa58ffec0ffa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.564742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.565840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.566691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.567142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.568294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.569018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.571286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.589617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 328/681] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.591091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.616024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba95d-7d1f-4b73-afdf-bcfc6de5dd9f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.652353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.656289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.657126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.657624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.658090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.659096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.659641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.661406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.680943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 354/682] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.687448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.732013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486bc-76c9-4ea4-85ae-3e18e9aeddd1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.758795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:42.777897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.778513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.778796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.779065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.779895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=79a68e7eaa644d2aa9616ba1dde8fd95) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.780321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.781760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.788934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 329/683] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/role_assignments?user.id=79a68e7eaa644d2aa9616ba1dde8fd95&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.789662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:42.867831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dcd1e-776b-432c-9c7f-61fd5213e4fa None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.919644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:42.920690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.921028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.921575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.922400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=840b8207e53043a8bab349f03f6ac109) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:42.922900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:42.925116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d319-62c9-4bd4-abd4-981193585e3d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:42.933367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 355/684] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/role_assignments?user.id=840b8207e53043a8bab349f03f6ac109&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:42.941669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a7984-ff0c-40ef-99b8-8a1da48d9fb9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.942034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a7984-ff0c-40ef-99b8-8a1da48d9fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.942371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a7984-ff0c-40ef-99b8-8a1da48d9fb9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.944196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 356/685] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:42.951061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:42.952749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:42.954825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:42.980548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98415-2d17-4dd6-8e76-0d9b6a0dd9d3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:42.982714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:42.984042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:42.984569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:43.028340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.028950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.029235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.029656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.071486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 357/686] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:43.119570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:43.121093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:43.227108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 330/687] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:43.232943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.295141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:43.353048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f0db-6cc9-4622-b679-25f2fdf28210 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:43.378251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.384156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:43.393696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.393696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.393696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.393696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:43.408692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:43.426722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:43.427722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:43.428651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:43.428651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:43.428651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:43.428651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 358/688] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:43.434182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.562792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3cb87-e7f1-4b34-810e-f215f7d6d5d2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:43.606950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.607592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.607867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.608172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.632624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:43.638518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:43.639421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:43.640295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 331/689] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:43.645544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a92590-4ce1-4eea-8684-fa084dc4d524 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:43.647595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.658704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:43.713461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.714448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.714934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.715406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.716499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:43.717008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:43.719362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:43.746546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 359/690] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:43.749850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.783898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:43.870026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375abd-9d54-4f53-8c6d-c516a9f7a2ad None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:43.881311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9bebb-2f9f-40b4-b4b3-477ffd355bff None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:43.917780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.918417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.918700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.919150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.919592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:43.920390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.920670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.920943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.921608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:43.921912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:43.923360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373646d-d5a3-46e7-8023-5deda7e73036 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:43.926472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:43.927939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:43.932627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 332/691] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:43.933974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32329b-235a-4318-b994-67ec27b2acc7 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.934360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32329b-235a-4318-b994-67ec27b2acc7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.934650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32329b-235a-4318-b994-67ec27b2acc7 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.940250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 333/692] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5928147f-660e-4f7e-8ce4-f6c4e6d81a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:43.940723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:43.941582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:43.942482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:43.942929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32329b-235a-4318-b994-67ec27b2acc7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:43.943000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 360/693] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:43.948105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:43.948389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:43.948665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:43.967786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:43.969053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:43.983471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.064016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 361/694] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:44.064016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.090097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32329b-235a-4318-b994-67ec27b2acc7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.136213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.149267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.149973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.150247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.150515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.172286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.177043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:44.207453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:44.208491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:44.209376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:44.209376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:44.209376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:44.214522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 334/695] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:44.215354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.230604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71902d4-b534-4f2d-b151-41c31381612d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.268558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.269171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.269495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.269719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.270402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:44.270701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.272148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.287626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 362/696] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:44.293577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.320583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.400620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04edd1d-5ee8-4c6e-9501-67f38c69f5c9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.439677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.440367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.440644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.440912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.441622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=085da9bf0ef94bf89f7254dd67301a76) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:44.441927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.443781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.452055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 363/697] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/role_assignments?user.id=085da9bf0ef94bf89f7254dd67301a76&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:44.453201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.468084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232dfab-7488-40d9-ad29-2950884f3eff None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.520587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.521609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.522092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.522588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.523481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:44.524012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.525891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.541471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 335/698] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:44.549348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.634660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.657035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.677470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99da50-1a40-4894-a764-861c8ee48cc9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.718128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e58bd-2be0-4148-9b15-a3b64d345036 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.725524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.726376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.726816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.727329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.742136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.743581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:44.764537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:44.765549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:44.766484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:44.766484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:44.766484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:44.769205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 364/699] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:44.772789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.773598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.774109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.774832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.780420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.787953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.789525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:44.805208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:44.806373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:44.807428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:44.808274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 336/700] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:44.813297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:44.919033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca800b84-9014-4fae-a754-7d5f2161a178 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.941026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.945712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec950-84da-4c3d-af1f-bf458e1935d3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:44.956437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:44.971024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.972177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.972613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.973078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.974463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:44.974966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.976950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.986802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d148-b897-4745-b830-e6978517df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:44.988500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d148-b897-4745-b830-e6978517df00 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:44.989108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d148-b897-4745-b830-e6978517df00 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:44.989879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d148-b897-4745-b830-e6978517df00 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:44.991124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d148-b897-4745-b830-e6978517df00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:44.991558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d148-b897-4745-b830-e6978517df00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:44.993482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d148-b897-4745-b830-e6978517df00 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:44.994863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 365/701] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:45.000947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:45.030439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 337/702] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:45.037702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d148-b897-4745-b830-e6978517df00 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:45.115279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa1687-e0cc-4953-9a5e-8321def266c0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:45.151455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:45.152366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.152819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.153236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.154086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:45.155674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:45.156015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d148-b897-4745-b830-e6978517df00 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:45.198937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:45.199539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.199821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.200137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.227523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:45.243536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 366/703] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:51:45 2022] POST /identity/v3/users => generated 254 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:45.294063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:45.295904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a5f09-6c54-439f-9c36-de3264d56fe1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:45.432009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 338/704] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:45.437392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:45.517280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:45.541417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5fb8-428a-461d-9bcf-a4e7a1ead2a2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.541738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5fb8-428a-461d-9bcf-a4e7a1ead2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.542047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5fb8-428a-461d-9bcf-a4e7a1ead2a2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.543578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 339/705] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:45.551141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f516-871f-465a-b260-aa058f48324b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.551421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f516-871f-465a-b260-aa058f48324b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.551698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f516-871f-465a-b260-aa058f48324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.585918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8285f516-871f-465a-b260-aa058f48324b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:45.587156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8285f516-871f-465a-b260-aa058f48324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:45.621606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378bdc-0113-4621-ba47-0207d6ff8e12 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:45.663052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:45.672439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:45.674263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.674263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.674263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.686691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:45.689952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:45.690206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 340/706] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:45.691566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288102-eee1-4bc9-a4d3-cbddf694851f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.691940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288102-eee1-4bc9-a4d3-cbddf694851f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.692365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288102-eee1-4bc9-a4d3-cbddf694851f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.694472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 341/707] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:45.700109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.700587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.700904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:45.714289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:45.715320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:45.716513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:45.716513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:45.716513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:45.716513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 367/708] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:45.723899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:45.726607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:45.727787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:45.842627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:45.848101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 342/709] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 07:51:45.854749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf21cf-abb0-41ec-97e0-11c6cfda9b61 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:45.890080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:45.890692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:45.890974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:45.891244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:45.892087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:45.892394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:45.893804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:45.906619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 368/710] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:45.917314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:45.992968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.105034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b4b0-4702-4c28-9bcc-adef0e91ec91 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.124674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:46.157699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.158342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.158620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.158889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.167681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.169265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.176821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b0fa-eb50-497c-927b-30f31ae8ab1c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:46.182244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:46.183113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:46.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 343/711] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:46.184548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.213775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.214414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.214691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.214965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] PATH_INFO: `/v3/services/network` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.215538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.216922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:46.228015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:46.230354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:46.232411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 369/712] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:45 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:46.234212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.250136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:46.292878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675402-4994-473c-8de7-afeaea1d1bec None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.330941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.331940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.332418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.332879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.333599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.335124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.335567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e0cf4-cc63-4f2d-b339-1807b66218ad None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:46.347047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:46.348219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:46.349059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:46.357081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 344/713] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:46.359079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.381641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.382366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.382757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.383115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.383884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.384337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.388058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.404125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 370/714] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:46.405806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.468386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:46.480531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb666ff-02fd-4d2a-b816-668fb1cddb5f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.492063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:46.515919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6985d7-c367-43fd-9b68-3ca02e7023f0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.518461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.519338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.519786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.520384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.521214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] RBAC: Adding query filter params (name=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.521687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.523239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.528480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 345/715] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:46.529939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.556020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.556820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.557212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.557569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.558273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.558651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.560219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.570716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 371/716] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:46.570716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.650186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2f78-3e8a-460e-b1dd-a7947eef5d20 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.668296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:46.671482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58caca-c218-4f77-a0b6-5b0b341c8c2a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.687288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.688223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.689372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.697753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.697753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.697753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.697753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.699804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 346/717] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:46.700954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:46.710104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.710738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.711069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.711352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.712006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.712358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.713798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c5b05-0603-4cdf-a457-9eea0a81c6c6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.728188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 372/718] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:46.831886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480dd68-b56e-425c-acf6-194ed4db9ef9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:46.871615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:46.872647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:46.873152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:46.873700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:46.874573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:46.875097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:46.877191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f56690-7c41-4a43-847b-35d4aff5f23f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:46.884288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 347/719] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:47.557982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c0f8-3ec0-4b1a-993e-38a01b6f9123 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:47.558501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c0f8-3ec0-4b1a-993e-38a01b6f9123 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:47.558608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c0f8-3ec0-4b1a-993e-38a01b6f9123 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:47.560161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 373/720] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:47.566243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f0d6-ca3a-4ec7-affc-c48f1ee1369c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:47.566533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f0d6-ca3a-4ec7-affc-c48f1ee1369c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:47.566813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f0d6-ca3a-4ec7-affc-c48f1ee1369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:47.589377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bbc9f0d6-ca3a-4ec7-affc-c48f1ee1369c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:47.590584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bbc9f0d6-ca3a-4ec7-affc-c48f1ee1369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:47.629326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:47.686151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 348/721] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:48.131388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ba92-c45a-44e3-825e-0c345ca1db2e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.131789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ba92-c45a-44e3-825e-0c345ca1db2e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.131970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ba92-c45a-44e3-825e-0c345ca1db2e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.133611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 374/722] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:48.138978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.139260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.139543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.166124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:48.166315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9ba92-c45a-44e3-825e-0c345ca1db2e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.167431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:48.173728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:48.276039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 349/723] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:48.325707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9ba92-c45a-44e3-825e-0c345ca1db2e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:48.382830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:48.383408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.383694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.383992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.404731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:48.411072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:48.412290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:48.413139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 375/724] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:48.418460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.555459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:48.565746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c664-9995-429f-b7d5-4a4035a3076a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:48.582164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.610057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:48.611583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.612019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.612430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.613416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:48.613722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:48.615110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:48.633445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 350/725] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:48.639107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.713230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:48.789328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7395-80f2-46a8-bca7-92bea207d848 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:48.822580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423df32-2f27-4c47-8873-17d48239a2c4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:48.856897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:48.857775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.858195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.858648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.864001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:48.864001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:48.864001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:48.864001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:48.874054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:48.875641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:48.884977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:48.890473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:48.891745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:48.892971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:48.894189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:48.895263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:48.896410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:48.896410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:48.896410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:48.900218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 351/726] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:48.904009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 376/727] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:48.905663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.910886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:48.926186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.028231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02b45-84c6-4ea3-9f1d-e09e55f2e8e4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.065117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.065755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.066041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.066318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.066965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:49.067270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.068674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.081550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 352/728] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:49.086974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.104379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72332-6c33-4617-9d66-4928701c8923 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.146599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.156789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.167673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.168424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.168815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.169157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.170132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:49.170554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.172087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.196027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 377/729] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:49.204170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59d90-7452-4bb3-a277-87818d23dbe8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.210767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.243006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.243948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.244465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.244917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.253209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.254926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-79e10078-9c38-4e85-ae0f-60825290d57a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:49.279670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:49.280674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:49.281621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:49.284505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 353/730] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:49.289305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a398dd-6810-4944-a41c-bb4d6fa87452 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.289305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a398dd-6810-4944-a41c-bb4d6fa87452 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.289305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a398dd-6810-4944-a41c-bb4d6fa87452 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.289305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 354/731] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:51:49.292842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a398dd-6810-4944-a41c-bb4d6fa87452 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.377740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a040f4-9cb2-4bdf-85b9-b9d9ea4c4393 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.412650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a398dd-6810-4944-a41c-bb4d6fa87452 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.427961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.429211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.429919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.430374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.439989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.447434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.448951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.449646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.449756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.450000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.450332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.451056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:49.451406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.453031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-3a459ed6-048c-4093-ad37-00b840b631de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:49.473119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:49.474296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:49.475183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:49.475183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:49.475183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:49.478150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 378/732] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:49.479497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.479944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.480409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.481569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 355/733] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:49.482521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.506334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:49.508226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:49.544267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.587831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 379/734] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:49.589543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.641604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d148145-33cc-4983-a23c-7f886874b3ac None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.685306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.686474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.687037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.687723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.689567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:49.690315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.692512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3fd42-8412-4811-86c0-561dbfef3c51 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.707844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e806-3b18-4e69-965c-426f57aaa239 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.708909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 356/735] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:49.711301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10294-9193-4198-afa0-815aec890f5e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.711596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10294-9193-4198-afa0-815aec890f5e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.711890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10294-9193-4198-afa0-815aec890f5e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.713376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 357/736] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:49.714354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6481-fb7a-407d-b2d4-e79d895a315e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.714591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6481-fb7a-407d-b2d4-e79d895a315e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.714862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6481-fb7a-407d-b2d4-e79d895a315e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.716181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 358/737] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:49.716903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6481-fb7a-407d-b2d4-e79d895a315e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.752260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.753137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.753137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.753410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.773701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.790536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.824572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.826045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c9314-5692-42d1-af46-cbfd2de0c48c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.833396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6481-fb7a-407d-b2d4-e79d895a315e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:49.868258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:49.868886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.869166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.869439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.878186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:49.879623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-6bfcb52f-00e2-4664-aa29-2ba9ea326e8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:49.890565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:49.892252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 359/738] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.893683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.894384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.911369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:49.912849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:49.931196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 380/739] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:49.932490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:49.932778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:49.933050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:49.977681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 360/740] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:49.978461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:49.994952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:49.996344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:50.012023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.067459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.073019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 381/741] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 07:51:50.073813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.088943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40369a-19a7-4912-82e0-2039f3820614 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.138085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.139103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.139590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.140366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.155292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:50.163116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:50.164087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:50.164964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:50.167705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 361/742] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:50.168778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.184271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8209c-1dc4-4c70-93a8-bb3573c5a358 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.220034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.220823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.221214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.221581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.222392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:50.222826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.224422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.247333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 382/743] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:50.248267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.293313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.300124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf2f4-d2df-4bb8-961f-ce1e82f3b363 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.311341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.335428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.336091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.336402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.336681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.347964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.349457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.354660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d25a-89ff-4334-a1ff-e39d22d54ccb None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:50.363684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:50.364764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:50.365674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:50.365674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:50.365674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:50.365674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 362/744] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:50.365899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.393154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.393755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.394027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.394288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.394941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:50.395244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.396623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.404291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 383/745] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:50.405035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.464817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635366-056a-418d-9f84-fabccb4539e7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.498286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.498826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.499108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.499431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.505281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0fbc1-ea48-47fb-88eb-0742690d1435 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.514023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.522022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.539192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.539817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.540123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.540397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.541036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.542409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.565405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.566849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.626683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 384/746] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:51:50 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:50.627556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.669953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 363/747] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:50.671346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.723010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.774567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f812992-fbf6-43ad-ac01-6fb368ebca5d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.790101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ac76-b0bb-4134-bdca-a9f6d39f5ae8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.815566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.816218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.816501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.816767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.817409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.818767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.834100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:50.834706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:50.834978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:50.835245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:50.836449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:50.836449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:50.837555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:50.851386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 364/748] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:50.852086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.889546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 385/749] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:51:50 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:50.890919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:50.934334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.973558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cdc2d-8000-4184-8791-54f0642fdc3b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:50.990982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.028972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cb935-5b71-4624-929d-3b44e79c2c8f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.029994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.031235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.032722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.033155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.056043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.059094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.074982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.076249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.076761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.077234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:51.081434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:51.082452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:51.084009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:51.084009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:51.084009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:51.084009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 365/750] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:51.084009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.095271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.097612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:51.114508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:51.115502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:51.116439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:51.116439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:51.116439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:51.116439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 386/751] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:51.117467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.221672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056eb3-0f41-4059-a5a2-4f528dabbb05 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.222346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.246782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567866f9-e637-483c-b83e-65f0ec3968b3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.260354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.261320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.261835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.262303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.276794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.278539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:51.291911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:51.293042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:51.294002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:51.296560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 366/752] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:51.298784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.304499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.305186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.305533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.307533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.308297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:51.308671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.310116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.324095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.325919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 387/753] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:51.327214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.437379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c799f-bc10-41d9-9b11-a500588c8074 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.455431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266b01f-a0c6-4347-a7c8-27fa931d11df None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.473047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.473813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.474244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.474606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.475540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:51.475782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.477266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.490789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 367/754] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:51.491819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.494769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.495797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.496542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.497010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.497884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:51.498395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.500132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.518812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 388/755] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:51.520171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.523263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.573554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.599042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd49b-0b02-4b12-a966-5d55c0e6853f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.633531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b76cf-ace9-44f7-afa0-aa9ed53a26fe None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.634233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.634845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.635129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.635401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.643411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.645057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:51.657847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:51.658923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 368/756] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:51.660441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.678390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.679473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.679946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.680452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.688085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.690181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:51.703643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:51.705168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:51.706169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:51.708714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 389/757] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:51.709708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.768326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c04c92-5bea-49d4-b542-035658d3846c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.777410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.804206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.804868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.805148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.805422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.806228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=085da9bf0ef94bf89f7254dd67301a76) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:51.806455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.808019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.809847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:51.820011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 369/758] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/role_assignments?user.id=085da9bf0ef94bf89f7254dd67301a76&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:51.820011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:51.851170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60288-0c14-431e-bb0d-e466e6cb1aa0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:51.929202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:51.929877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:51.930155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:51.930423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:51.931161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:51.931467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:51.932952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:51.978473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 390/759] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:51.981568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:52.019100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d26c2-ca2f-4c5b-9521-5cbc19547958 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.085360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.085981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.086256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.086526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.087224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:52.087528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.088993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.107280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 370/760] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:52.108489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:52.146080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1ec0-f2ef-477b-be8c-003fad9c10b9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.166962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:52.176423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:52.195716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.196382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.196660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.196933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.216027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.217559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.223415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092cb9b-d57f-46b1-b80d-3648c1d5e414 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:52.245682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:52.246830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:52.247853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:52.247853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:52.247853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:52.249746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 391/761] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:52.254839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:52.258858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.259474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.259746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.265331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.266142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=1a0ea18309fb47cfa5efe4f6f95beec6) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:52.267116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.268753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.284109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 371/762] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:51:52 2022] GET /identity/v3/role_assignments?user.id=1a0ea18309fb47cfa5efe4f6f95beec6&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:52.451109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16901-9e34-4eb8-aab4-1614c4e255ef None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.502735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.503351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.503630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.503902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.504563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:52.504863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.506224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.519075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 392/763] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:52.524210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:52.676493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522eec1-370d-4d1f-80cd-87256e9af1aa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.713407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:52.722818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.723506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.723792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.724100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.731489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.733045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:52.744863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:52.746882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:52.747955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 372/764] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:52.752315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:52.785212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:52.873211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ee36-be0b-477c-8dcc-bb88de1db977 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:52.923597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:52.924247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:52.924530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:52.924805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:52.925491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:52.925793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:52.927228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5a5b-6899-40e9-9b46-3a9f9663a028 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:52.946093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 393/765] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:52.951922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:53.068997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581e4e7-4d75-43b7-ba10-6513d03b389a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:53.106982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:53.107653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.107933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.108242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.110715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=5f3b6c53dcc844c784c17f6c4af76bfb, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:53.112623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f822f-6e1f-45ac-96e9-a874f642eddd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:53.153202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5152-652d-4539-8530-d12233dca708 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.153504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5152-652d-4539-8530-d12233dca708 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.153763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5152-652d-4539-8530-d12233dca708 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.155633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 394/766] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:53.161259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cc845-6910-4fe4-8879-ddf7614524ec None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.161546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cc845-6910-4fe4-8879-ddf7614524ec None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.161825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cc845-6910-4fe4-8879-ddf7614524ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.183249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-be6cc845-6910-4fe4-8879-ddf7614524ec None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:53.184563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-be6cc845-6910-4fe4-8879-ddf7614524ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:53.219871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 373/767] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:52 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:53.283638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 395/768] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:51:53.502809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16d3e-6d5c-4032-a6f4-92737d137772 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.503148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16d3e-6d5c-4032-a6f4-92737d137772 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.503322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16d3e-6d5c-4032-a6f4-92737d137772 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.504691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 374/769] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:53.510334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.510620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.510894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.536842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:53.538286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:53.554519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.615095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 396/770] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:53.641239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca16d3e-6d5c-4032-a6f4-92737d137772 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:53.691324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.772578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca16d3e-6d5c-4032-a6f4-92737d137772 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:53.813696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:53.814456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:53.814739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:53.815074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:53.815664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:53.817123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:53.826105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:53.827059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:53.827879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:53.832106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 375/771] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:53 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:53.837090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:53.975887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7e6-4970-48a6-bc04-50a364467f8b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.026634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.027579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.028113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.028579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.029393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.029902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.031455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.039924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 397/772] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.045956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.083682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.119453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:54.200775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ec0-b1b6-4530-af21-aa3b8ebf8fa1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.208476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:54.238956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.239832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.240145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.240426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.241069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] RBAC: Adding query filter params (type=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.241379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.242765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.254511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 376/773] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.266786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.293876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4f49c-ae54-40fd-ab67-fb3f36fc84e8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.374394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.375345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.376361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.376816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.377617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.379158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:54.405567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:54.406654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:54.408525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 398/774] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:54.417053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.424311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc88e-b0e5-41a0-8487-5d6879839a5d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.463391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.464365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.464974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.465432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.466462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] RBAC: Adding query filter params (interface=public, service_id=05395082ffd140a0baf0c702486b3428, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.466957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.468557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.477109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 377/775] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/endpoints?service_id=05395082ffd140a0baf0c702486b3428&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.486136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.561536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:54.562078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:54.586900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab754-bd0b-49f1-84af-6e95403f5c28 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.624566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.625555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.626262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.626611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.627473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.627765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.629328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec7af-06e1-448f-ba36-edae44b0c6a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.636035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb23ad8-8cd9-4f71-ad10-fabee52fb7ee None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.640226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 399/776] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.642430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7a4-218d-4130-8cce-87d5ceb94899 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.642782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7a4-218d-4130-8cce-87d5ceb94899 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.642996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b7a4-218d-4130-8cce-87d5ceb94899 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.644520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 400/777] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:54.645223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7a4-218d-4130-8cce-87d5ceb94899 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.676341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.677415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.677971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.678468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.679271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.681094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3915b61-b82d-470d-96aa-c38f831b96f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.687313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 378/778] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.689019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240aa3-c992-4135-a6b2-069cd020b532 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.689535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240aa3-c992-4135-a6b2-069cd020b532 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.690016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240aa3-c992-4135-a6b2-069cd020b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.710603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-89240aa3-c992-4135-a6b2-069cd020b532 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:54.712383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-89240aa3-c992-4135-a6b2-069cd020b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:54.768547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b7a4-218d-4130-8cce-87d5ceb94899 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.807873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.808678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.808960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.809232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.809870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.810362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.811827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.818822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 401/779] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:54.824607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:54.840390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:54.908374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 379/780] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:54.950878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376404a-44c1-49e9-b95f-d7c408c4c646 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:54.988092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:54.988713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.988988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.989283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.989946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] RBAC: Adding query filter params (interface=public, service_id=6580be5f769d4727a50f56a92e9de6fb, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:54.990250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:54.991597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:54.994291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1953-96b5-49d4-9cc4-2f32fa775ed6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:54.994587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1953-96b5-49d4-9cc4-2f32fa775ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:54.994839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1953-96b5-49d4-9cc4-2f32fa775ed6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:54.996420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 380/781] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:54.999796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 402/782] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:51:54 2022] GET /identity/v3/endpoints?service_id=6580be5f769d4727a50f56a92e9de6fb&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:55.002263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.002263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.003078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.006040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.034570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:55.034570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:55.065262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:55.085858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:55.145421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e51aa2-1aac-4cc7-8b7a-a1558f966ac5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.162562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 381/783] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:55.182375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.182991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.183274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.183549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.184188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:55.185547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:55.191625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 403/784] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:55.233165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.374637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6d42-e3c4-4c11-9cc8-04a92c445fd3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.416723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.417403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.417682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.417954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.430466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:55.435251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:55.436229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:55.437477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 382/785] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:55.442686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.503674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.525048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:55.561187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7218-9108-4b75-b9a1-2a5e4a61329a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.611771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.612285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.612563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.612836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.613494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:55.613795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:55.615252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:55.618938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3f10-1bd0-4f7f-b5ac-b4b7520b3df6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.622254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:55.633203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 404/786] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:55.639016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.656045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.656679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.657651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.658058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.669450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:55.674398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:55.675335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:55.676213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 383/787] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:55.681513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.769693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:55.790820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbff44-6525-4c91-9c1d-9151e0bcc104 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.828689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.829807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.830087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.830359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.831020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:55.831325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:55.832721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:55.837785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653afe61-091d-4a73-9412-26cf4361a6b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.854876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 384/788] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:51:55.860802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.888757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:55.889403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.889593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.889867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.900954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:55.902444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-36efd42a-bfab-4c06-a96d-c79af3054a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:55.918619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:55.923685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 405/789] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeddf-e675-4ecc-8f0e-ae207b5c7451 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeddf-e675-4ecc-8f0e-ae207b5c7451 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:55.924609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeddf-e675-4ecc-8f0e-ae207b5c7451 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:55.927593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 406/790] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:55.928470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaeddf-e675-4ecc-8f0e-ae207b5c7451 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:55.972012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0779-367e-4e88-9744-56e59cd8ef65 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:55.984429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.012849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.013560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.013857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.014107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.027078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.028694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.035699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.039206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaeddf-e675-4ecc-8f0e-ae207b5c7451 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-397f25bc-6f67-4568-a3aa-e4b574b5400e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:56.045577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:56.047427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:56.049956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:56.049956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:56.049956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:56.049956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 385/791] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:51:56.050337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a640-5468-4b67-8b12-0df219038825 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.050471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a640-5468-4b67-8b12-0df219038825 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.050632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a640-5468-4b67-8b12-0df219038825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.074270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5887a640-5468-4b67-8b12-0df219038825 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:56.075469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5887a640-5468-4b67-8b12-0df219038825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:56.085685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.086727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.087004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.087276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.088351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:56.088934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.090595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.109439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 407/792] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:56.110393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.163243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 386/793] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:56.164117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a640-5468-4b67-8b12-0df219038825 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.282158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a640-5468-4b67-8b12-0df219038825 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.295869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7fcd-2eeb-4efc-b0fa-47bbafc05637 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.311598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.315941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.337218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.338309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.338795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.339960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.357300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.359470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.369696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.375383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.375383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.375383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.375383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:56.375383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.380082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:56.389927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:56.390971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:51:56.392259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:56.397379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 387/794] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:56.402676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.409559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 408/795] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:56.416330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.545396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681034-7388-4325-9f62-fb8ac20bf3a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.585066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491aa9-bb38-48e4-932b-25edf809b858 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.592736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.593589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.595142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.595630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.597026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:56.597791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.600133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.623638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.624041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 388/796] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:56.625107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.629350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.630333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.630333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.638364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.640071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:56.651763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:56.652755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 409/797] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:56.653719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.683419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.687066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.762353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484717-ff99-4003-bfbd-6f4891f89b61 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.774839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205de42-37f5-4cfb-95bd-ded216bd9edb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.799496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.800309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.800757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.801039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.812547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:56.814043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:56.821953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:56.823301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:56.824037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:56.824484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:56.829572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:56.830941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:56.832089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:56.832089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:56.832089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:56.833287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 410/798] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:56.834232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.841004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:51:56.847351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:56.848610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:51:56.849686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:56.852731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 389/799] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:56.853929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:56.932774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.959866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06e34-fbec-4b4b-93bf-b288a133d153 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:56.979561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:56.983098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1bce-933b-4a1f-ab2d-81096f7a34d9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.004969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.005800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.006247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.006672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.007551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.008029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.012687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.026291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.027080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.027457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.027823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.028583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.028979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.030449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.035368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 411/800] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.036439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.053459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 390/801] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.054601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.164158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de7a8-f891-4b24-a083-f6aa15429f16 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.174201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67b932-f296-4999-a389-51db1fc3778c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.204898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.205886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.206271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.206642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.219178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.220501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.220908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.221270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.222051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.222172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.222526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.223973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.224117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.234094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 412/802] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.235232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.238559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:57.243756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:57.244892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:57.245978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:57.245978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:57.245978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:57.247637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 391/803] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:57.248677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.269307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.358036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917022-23fd-4d51-bda8-b4bff149e3b8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.360003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb534-a2f4-4a0a-b6f0-dcf08251d5de None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.395249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.395885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.396197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.396472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.399057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.399753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.400125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.400457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.407280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.407690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.408867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.409205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:57.420844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:57.421908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:57.423060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-020decc5-579b-4bc8-bb5d-42de1b1bd25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:57.423903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:57.424832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:57.425704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:57.425704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:57.425704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:57.428326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 413/804] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:57.428776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 392/805] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:57.428938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.430544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27709f-b419-4edc-8f4f-ddd9f2bde66b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.430920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27709f-b419-4edc-8f4f-ddd9f2bde66b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.431292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27709f-b419-4edc-8f4f-ddd9f2bde66b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.433607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 393/806] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:57.433607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27709f-b419-4edc-8f4f-ddd9f2bde66b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.496196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.500124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.538251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdc943-d01f-4969-b87c-7291c6f53bc1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.540649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27709f-b419-4edc-8f4f-ddd9f2bde66b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.573895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.574502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.574807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.575084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.575707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.576030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.577382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.578033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.579416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.579854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.580296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.580977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.581282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.582684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e929-6c04-4330-88ee-96c467a8e2d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.590629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 414/807] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.591257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.599493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 394/808] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.600739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.601016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.601287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.619823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:57.621032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:57.700678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 395/809] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:57.702442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.704658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef7cd-71af-41a8-9de4-b2001249cb12 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.740037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.755652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.756365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.756682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.756956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.757885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:57.758189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.759561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.763656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:57.772964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 415/810] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:57.783134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.826115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c62b7-81ff-45e9-97a0-af128387a21c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.862421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.863059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.863362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.863636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.870295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.871740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:57.884388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:57.885280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:57.886153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:57.887021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f81c5-ce42-4eae-86e8-506dcde5a5ee None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:57.888318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 396/811] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:57.892027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:57.921720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:57.923158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:57.923443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:57.923707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/085da9bf0ef94bf89f7254dd67301a76/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:57.926044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=085da9bf0ef94bf89f7254dd67301a76, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:57.927467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6690a-bd0e-43f0-8277-1a7a03fbc2af None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.003779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 416/812] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:57 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/085da9bf0ef94bf89f7254dd67301a76/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:58.005852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415f93-e16c-4b99-b4dd-c67177e2bad8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.006142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415f93-e16c-4b99-b4dd-c67177e2bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.006358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415f93-e16c-4b99-b4dd-c67177e2bad8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.007901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 417/813] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:51:58.008597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0415f93-e16c-4b99-b4dd-c67177e2bad8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.071747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.124694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ffbb4-4725-4d1c-8a3d-9bf712f33d7b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.143853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.169564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.170239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.170515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.170785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.179657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.181862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:51:58.199643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:58.200723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 397/814] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:51:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:58.201873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.259653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0415f93-e16c-4b99-b4dd-c67177e2bad8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.295895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.296541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.296817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.297087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.298327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:58.298626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.300066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e08935-0008-4ae7-9779-7844d0080985 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.316045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 418/815] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:58.316045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.316045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.316045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.323303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2514d37-de6f-4c7e-b704-afdcea06dc90 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.331751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:51:58.332946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:51:58.360640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.361280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.361538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.361809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] PATH_INFO: `/v3/services/network` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.362394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.363750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:58.372512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:58.373516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.374342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 398/816] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:58.375143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.412411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 419/817] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:51:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:51:58.412411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.422653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.448538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.495875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b3c5-802c-431b-af89-604a6fce2f1d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.532747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3ea7e-f760-4f99-9cab-755a9f82dbcf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.542708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.543886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.544293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.544661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.545874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:58.546283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.548477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.568649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 399/818] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:58.569570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.571790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.572859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.574448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.574871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/1a0ea18309fb47cfa5efe4f6f95beec6/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.593545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=1a0ea18309fb47cfa5efe4f6f95beec6, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.595501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.668726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 420/819] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:51:58 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/1a0ea18309fb47cfa5efe4f6f95beec6/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:51:58.669922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.673308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.680522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6e52-b857-4691-8fc4-252c6834e923 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.732294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.732892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.733174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.733450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.734331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] RBAC: Adding query filter params (name=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:58.734451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.736528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.742759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 400/820] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:58.743674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.790874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:58.818493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f03309-1cc0-487b-82b2-b6714390e26e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.862453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17f79-ec79-427f-8686-aeafe56b1d5b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:58.867762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.868675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.869105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.869524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.908104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:58.909279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:58.909731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:58.910307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:58.911040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.913288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:58.923929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:58.925904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 07:51:58.927215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:58.930821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 401/821] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:58.938556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:58.963720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:58.965391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:58.968914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.061828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.073383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893812a-4487-410b-b860-a7272c046a3e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.094771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 421/822] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:51:59.094771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.115067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.115707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.116001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.116291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.116918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] RBAC: Adding query filter params (type=network) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:59.117312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.118580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.124067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 402/823] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:51:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:59.124912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.217470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab51eb3-e063-4239-8c6b-a0b746e83081 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.233802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.249738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8de5a-6601-466c-a5ab-a00c30fc8429 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.256492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216be1-96a2-418d-a186-752454985914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.257178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216be1-96a2-418d-a186-752454985914 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.257565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216be1-96a2-418d-a186-752454985914 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.257955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216be1-96a2-418d-a186-752454985914 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.258693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216be1-96a2-418d-a186-752454985914 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:59.259083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216be1-96a2-418d-a186-752454985914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.260705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216be1-96a2-418d-a186-752454985914 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.272371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 422/824] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:59.272371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216be1-96a2-418d-a186-752454985914 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.303279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.304098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.304382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.304654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.316478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.318059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.324970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:51:59.335347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:59.336588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:51:59.337492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:51:59.337492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:51:59.337492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:59.339584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 403/825] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:59.340704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.389819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216be1-96a2-418d-a186-752454985914 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.434035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.434642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.434914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.435180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.435839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.437212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.468632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb39d-1e28-4b49-96bd-db0e5d79c03a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.505596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.506203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.506480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.506752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.507378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:59.507681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.509081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.515224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 404/826] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:59.516491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.521248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.528919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 423/827] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:51:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:59.530216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.654429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475eae-451c-4ac8-9d32-e5cef40813af None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.731299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.733000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.733677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.735841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.736785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:51:59.737522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.739930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.750878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f6f7-ae97-40c7-9b00-ccac1ed35dec None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.752744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.758871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 405/828] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:51:59.765094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:51:59.801675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.803220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.803536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.803810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.804519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.805886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.845560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:59.865578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 424/829] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:51:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:51:59.903431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea810c-1cdc-431a-a1e8-a4f094e4beef None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:51:59.950940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:51:59.951492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:51:59.951762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:51:59.952131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:51:59.960813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:51:59.962309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:51:59.976161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:51:59.977189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:51:59.978084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 406/830] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:51:59.983150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:00.103575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4218-b735-4a3c-afc9-cadf37f4d120 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:00.139431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:00.140068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.140352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.140623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.141443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:00.142008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:00.143451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10f861-3f59-4cda-9378-c61107f607a6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:00.156348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 425/831] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:00.162973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:00.271069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a63-93bd-406a-9503-fe85a1c8ba6a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:00.284646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:00.304785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:00.305416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.305696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.305967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.306715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:00.307025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:00.308559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb5d82-2e2e-4660-bb24-e1ae0da47d0b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:00.316250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 407/832] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:00 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:00.427228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4983f-a823-41a6-81ed-6cb0f663538f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.427520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4983f-a823-41a6-81ed-6cb0f663538f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.427780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4983f-a823-41a6-81ed-6cb0f663538f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.429449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 426/833] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:00.435241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53064-8889-4d29-bc8a-20ad1b7e2f79 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.435523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53064-8889-4d29-bc8a-20ad1b7e2f79 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.435878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53064-8889-4d29-bc8a-20ad1b7e2f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.456919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9db53064-8889-4d29-bc8a-20ad1b7e2f79 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:00.458138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9db53064-8889-4d29-bc8a-20ad1b7e2f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:00.534311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 408/834] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:00.809757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4983f-a823-41a6-81ed-6cb0f663538f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:00.830759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:00.922394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4983f-a823-41a6-81ed-6cb0f663538f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:00.963132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:00.963767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.964071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.964345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.970156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea627d8-adf7-47ad-8ea3-8deb80bdc811 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.970445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea627d8-adf7-47ad-8ea3-8deb80bdc811 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.970722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea627d8-adf7-47ad-8ea3-8deb80bdc811 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.975553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:00.975903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 409/835] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:00.977362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:00.977654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:00.977930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:00.980342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:00.981268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:00.982108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 427/836] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:00.987872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.004680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:01.006363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:01.081250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.100467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 410/837] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:01.120018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bae1d-328c-495b-b764-8d201ac6b961 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.154902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.155510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.155785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.156110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.157310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:01.157609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.158953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.167994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 428/838] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:01.174098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.216293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.279778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1dd9e-97e7-4807-acb7-16c29d568556 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.317976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.318957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.319437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.319938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.333124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.334874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:01.350091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:01.351106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:01.352049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:01.352049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:01.352049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:01.354306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 411/839] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:01.361511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.415471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.469565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc638-b826-4ac3-a6fe-ea1c0c01610e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.504614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.505219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.505835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.505835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.506359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:01.506655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.508005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.517812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.522595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 429/840] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:01.528143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.540953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.550024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced662a4-f9f7-444e-a297-e82a4c4470ee None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.592556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.594046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.594791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.595245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.609586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:01.616713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:01.617643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:52:01.618598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:01.626843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 412/841] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:01.628018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.652788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe8c88-dfd7-425a-865e-dee88c9167b5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.693571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.694637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.695164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.695797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.704872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.707735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:01.723081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:01.724384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 07:52:01.725351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:01.728590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 430/842] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:01.736999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.743680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8e4c-0bcb-43cb-8c90-a2e60713f35d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.786461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.787335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.787619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.787889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.788613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:01.788901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.790277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.800024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 413/843] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:01.805987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.824837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.830728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:01.880400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d74f30-c54c-4c2a-8ba8-bdf9880e81de None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.921616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.921977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360dc6-123a-4d5d-a406-aa99ca9df9d7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:01.922899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.923376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.924186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.926074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:01.926645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.928454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.952955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 431/844] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:01.954388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:01.961268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:01.962145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:01.962596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:01.963050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:01.974793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:01.976533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:01.992335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:01.993288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:01.994182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:01.994182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:01.994182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:02.000315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 414/845] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:02.002254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.070907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2be9-09ea-49d4-bfbf-2cd85460ac91 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.075519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.093123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.114238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed37d-1321-446e-9536-1766617ed194 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.114557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.115375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.116051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.116516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.152230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.152738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.153095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.153465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.154161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:02.154563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.156354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.174848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 415/846] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:02.175954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.207574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.209355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81985f9-de31-4be9-bc15-0dc50494f791 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.320446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d23e5-08c8-4737-8d5a-c6642a20cd8d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.327826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 432/847] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:02.329982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988e80-a043-4502-a413-e086e9d061e8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.330210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988e80-a043-4502-a413-e086e9d061e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.330486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988e80-a043-4502-a413-e086e9d061e8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.331928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 433/848] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:02.334030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988e80-a043-4502-a413-e086e9d061e8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.352142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.354667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.360802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.361488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.361702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.361969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.369430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.370849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-461a6356-1bfc-4dfe-b030-c07377c06c4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:02.384848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:02.385844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 416/849] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.392654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.393376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.409726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:02.410860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:02.445621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988e80-a043-4502-a413-e086e9d061e8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.479190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 417/850] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:02.479853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.497350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.498671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.499185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.499659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.514855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.518076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:02.537788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:02.538869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:02.539767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:02.539767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:02.539767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:02.546425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 434/851] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:02.547884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.590625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fa640-30df-41fd-b738-cfff2cc8927b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.609581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.631394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.632091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.632948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.633249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.633996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:02.634373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.636278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.636914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.666449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 418/852] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:02.667908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.678952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51921-ebdb-4c5c-bf1b-93d6c7ead248 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.722733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.723534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.723958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.724273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.725008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:02.725314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.726664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd38d-4ab9-42df-bd4c-a3bf9e07803a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.741698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 435/853] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:02.742908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcc431-490c-4483-b006-fd80a014d05e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.743191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcc431-490c-4483-b006-fd80a014d05e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.743461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcc431-490c-4483-b006-fd80a014d05e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.748081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 436/854] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:02.748081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcc431-490c-4483-b006-fd80a014d05e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.787701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90787ce-9fd8-4cb0-a4aa-2e4fe403b6d5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.820935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.821530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.821810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.822078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.847863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcc431-490c-4483-b006-fd80a014d05e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:02.864868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.877086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:02.882923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:02.883549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.883826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.884130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:02.888606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.890044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775540-99d6-4df0-813b-1ea62595a314 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.890641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:02.892675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:02.903695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:02.906218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 437/855] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:02.907251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:02.990909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 419/856] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:02.992167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:02.992457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:02.992736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.011038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:03.012258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:03.012359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79f207-71e3-4a59-ad74-d3fc6b30ef36 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.044881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.045507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.045789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.046055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.046633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.048583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:03.057096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:03.058099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:03.058951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 438/857] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:03.065478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.081994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 420/858] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:03.083400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.090529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.130840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.182591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235569d-d59e-4ec2-93be-70f6a9e18a2c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.191923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6825d-9056-49a5-aa17-c08b195ae1e0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.218888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.220046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.220319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.220584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.221325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.221547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.222943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.227884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.228545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.228825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.229100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.240270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 439/859] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.240270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.244771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.246170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:03.263474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:03.264480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:03.265382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:03.265382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:03.265382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:03.265382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 421/860] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:03.265382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.325841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.354601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733f58d-343b-4ba4-837e-b349416f3694 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.369608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.371611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302e719-d6e9-4314-ab63-a179b34dd460 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.389984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.390603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.390863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.391357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.391992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.392309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.393660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.398604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 440/861] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.399787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.406195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.407299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.407570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.407837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.408591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=085da9bf0ef94bf89f7254dd67301a76) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.408892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.410303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.416310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 422/862] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/role_assignments?user.id=085da9bf0ef94bf89f7254dd67301a76&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.417075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.533101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d376e-777d-42b5-8d62-a4d44be38fde None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.545183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262cbc-6299-41c1-8c4e-fe204d5a0766 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.568580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.569482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.570108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.570389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.570657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.571303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.571602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.573027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.585725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870610-5708-417b-9b53-18163822e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.586468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 441/863] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.586935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870610-5708-417b-9b53-18163822e02a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.587320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.587649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870610-5708-417b-9b53-18163822e02a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.588175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870610-5708-417b-9b53-18163822e02a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.588775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16870610-5708-417b-9b53-18163822e02a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.590178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16870610-5708-417b-9b53-18163822e02a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-16870610-5708-417b-9b53-18163822e02a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:03.601683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:03.603128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:03.604044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 423/864] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:03.604847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870610-5708-417b-9b53-18163822e02a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.645794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.708339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd004-6a90-4289-a17a-3c96c8225ee5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.727317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870610-5708-417b-9b53-18163822e02a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.745629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.746231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.746503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.746768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.747515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.747815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.749217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.753639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 442/865] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.764217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.778400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.779198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.779548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.779927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.788449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.789923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:03.804087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:03.805062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:03.805977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:03.806402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 424/866] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:03.813738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.870878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.904493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc8fa3-1abe-4664-a46e-657042179765 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.907206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:03.937318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d6e55-4e02-438e-b017-39d180d90c3b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:03.946366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.947176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.947561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.947958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.948733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.949248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.950741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.960776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 443/867] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:03.961870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:03.978229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:03.978849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:03.979187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:03.979460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:03.980225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:03.980581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:03.982057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:03.995690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 425/868] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:04.003717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:04.073594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b915e-66a8-402b-8b13-5cd092fa8f45 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:04.110731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f94e2d-8dd6-46a7-9935-7481f4894beb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:04.118910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:04.131697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:04.132474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:04.132757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:04.133106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:04.133758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:04.134058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:04.135422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3e5d3-188d-47f4-89c6-6d0fec4ba2f8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:04.141391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 444/869] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:04.173382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:04.174021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:04.174297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:04.174565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:04.175316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=1a0ea18309fb47cfa5efe4f6f95beec6) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:04.175690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:04.177268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75984801-2a2e-4fe9-905a-fa4e100995c8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:04.184407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 426/870] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:04 2022] GET /identity/v3/role_assignments?user.id=1a0ea18309fb47cfa5efe4f6f95beec6&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:05.697321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd79e-22f3-4597-9fa8-1dc5454dfd53 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:05.697846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd79e-22f3-4597-9fa8-1dc5454dfd53 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:05.697846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd79e-22f3-4597-9fa8-1dc5454dfd53 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:05.699445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 445/871] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:05.705373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb0563-7fb9-463f-b836-ac3f61b5bad5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:05.705783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb0563-7fb9-463f-b836-ac3f61b5bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:05.705959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb0563-7fb9-463f-b836-ac3f61b5bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:05.724488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d7eb0563-7fb9-463f-b836-ac3f61b5bad5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:05.725670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d7eb0563-7fb9-463f-b836-ac3f61b5bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:05.801500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 427/872] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:06.065135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6675b-fd1b-4d06-97de-84fb1484198e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.065847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6675b-fd1b-4d06-97de-84fb1484198e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.066327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6675b-fd1b-4d06-97de-84fb1484198e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.068192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 446/873] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:06.073858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.073988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6675b-fd1b-4d06-97de-84fb1484198e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:06.074468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.074938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.098354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:06.100416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:06.105406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:06.189072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6675b-fd1b-4d06-97de-84fb1484198e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:06.204117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 428/874] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:06.230942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:06.231575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.231857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.232161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.232741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:06.234113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:06.244736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:06.245726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:06.246561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:06.250923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 447/875] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:06.252545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:06.285739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:06.370072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9665a71-d499-44b8-a87d-a29bab01b1a0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:06.412378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:06.413001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.413285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.413565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.414201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:06.414507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:06.415891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6f82a-0881-493b-aa17-96e7091aeb84 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:06.420930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 429/876] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:06.427345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:06.465667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d648cf-6ae4-47ff-b58a-70f0a810c738 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.465974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d648cf-6ae4-47ff-b58a-70f0a810c738 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.466217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d648cf-6ae4-47ff-b58a-70f0a810c738 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.467777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 430/877] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:06.473016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.473297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.473568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.492384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:06.493621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:06.531806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:06.538614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b80a52-2536-419b-a270-f956f4d3ae92 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:06.562448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 431/878] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:06.563918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:06.572454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:06.573054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.573328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.573598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.574209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:06.574506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:06.575847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738b44-bff3-40bc-b3d9-79209891d286 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:06.587456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 448/879] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:06.587456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b83b-c03c-40b5-bc51-dccb6d42c1a2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.587456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b83b-c03c-40b5-bc51-dccb6d42c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.587456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b83b-c03c-40b5-bc51-dccb6d42c1a2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.587456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 449/880] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:06.592885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.592885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.592885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.599560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:06.612509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:06.613756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:06.691535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70a85-643b-4174-a348-ac668707caf3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:06.704669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 450/881] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:06.771132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:06.771835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:06.772076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:06.772319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:06.772979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:06.780093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:06.838627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:06.849885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 432/882] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:06 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:07.030415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:07.031352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:07.074179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3bc8-8ce7-4039-bdd2-2677fce0679f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.135311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:07.143057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.143667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.143944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.144296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.144888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:07.146425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:07.158504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01365bd-77fc-4c15-9729-aa3ac18c51a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.196048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.196938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.197217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.197494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.209616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:07.214339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:07.215278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:07.216307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 433/883] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:07.221789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:07.232381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 451/884] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:06 2022] POST /identity/v3/services => generated 269 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:52:07.346921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd6275-448a-40c1-97f9-a8d9d19fc9e9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.392717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.393338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.393616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.393889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.394568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:07.394871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:07.396424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:07.402455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:07.406985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 434/885] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:07.417144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:07.529225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417561b-839e-4373-ba89-c07afebc390e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.565173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.566222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.566698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.567161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.579650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:07.581552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:07.584912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:07.598530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:07.599489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:07.600919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:07.600919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:07.600919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:07.600919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 452/886] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:07.605798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:07.715078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364381b-058c-4647-be32-d17b2537b838 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.753686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.754664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.755155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.755653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.756529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:07.757036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:07.758599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:07.772377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 435/887] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:07.780517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:07.886950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edffa2a-4e22-4501-a90b-c4bd784d80d8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:07.923932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:07.924942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:07.925442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:07.925931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:07.933999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:07.935663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:07.947918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:07.948915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:07.949867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:07.952355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 453/888] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:07.961103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:08.023727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:08.071804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092353e-eb45-4def-99e8-b38c65b92be9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:08.108290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:08.109200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.109656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.110178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.111378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:08.111964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:08.113906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:08.133493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 436/889] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:52:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:08.141666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:08.200510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:08.247088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9913-7b5e-4034-b9ae-a1fd7c50eed3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:08.292992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:08.293657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.293941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.294217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.370070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:08.371581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:08.428110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:08.474827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 454/890] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:08.480170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:08.590126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc50a-3574-4641-9bfb-6252a478340e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:08.609393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:08.627493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:08.631680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.631680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.631680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.639240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:08.640713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:08.655895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:08.657561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:08.658543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:08.658543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:08.658543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:08.658543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 437/891] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:08.665330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:08.775212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd97a4-f4d3-4740-b60d-752ee1bf1939 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:08.815618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:08.816301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.816539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.816848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.817451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:08.817753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:08.819117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046d8a-8150-4752-8182-41fb1096085d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:08.831846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 455/892] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:08.837212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:08.901143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be5c3-47d6-427e-9750-96fba22cbd24 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.901478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be5c3-47d6-427e-9750-96fba22cbd24 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.901732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be5c3-47d6-427e-9750-96fba22cbd24 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.903072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 456/893] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:08.908466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.909289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:08.910038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:08.931342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:08.938700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:08.946419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:08.949738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10423e-96b2-4c49-a050-3f3fb1252e42 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:08.994229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:08.995229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:08.996204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.001591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.006760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:09.010219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:09.016818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 457/894] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:09.027101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:09.028310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:09.029255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:09.029700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 438/895] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:09.036251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:09.159930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34daf4-ce4f-4475-bedb-9ada48bc85f6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:09.197145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:09.198152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.198660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.199202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.200223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:09.200806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:09.202413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a32ad-ac74-4b67-814f-916028abbc68 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:09.214998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 458/896] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:09.221810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:09.254093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3eca-1b80-4eec-8589-be36792ca1c1 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.254443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3eca-1b80-4eec-8589-be36792ca1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.254648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3eca-1b80-4eec-8589-be36792ca1c1 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.255456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:09.259843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 459/897] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:09.261006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.261293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.261570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.278320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:09.285022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:09.286329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:09.341010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb3bd-3e6a-46f8-ab4a-05b6eafe9e34 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:09.361544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 460/898] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:09.362669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:09.377748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:09.378717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.379195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.379664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.380651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] RBAC: Adding query filter params (role.id=47b78af1eb9840c2965c5cd176969e3a, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=1a0ea18309fb47cfa5efe4f6f95beec6) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:09.381172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:09.382792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:09.396442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 439/899] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:09 2022] GET /identity/v3/role_assignments?user.id=1a0ea18309fb47cfa5efe4f6f95beec6&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=47b78af1eb9840c2965c5cd176969e3a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:09.481251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdc164-d1ac-460d-8867-22ad7758e11c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:09.521393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:09.522023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.522344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.522624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.523287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:09.524700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787ea2-a927-4cc8-9077-b954e009c459 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:09.529401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:09.603967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 461/900] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:09 2022] POST /identity/v3/services => generated 241 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:09.645084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:09.693943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58dea-02cd-4577-b32f-aa67436d2cf9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.694279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58dea-02cd-4577-b32f-aa67436d2cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.694492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58dea-02cd-4577-b32f-aa67436d2cf9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.696213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 462/901] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:09.701951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.702267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.702514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.723256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:09.724499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:09.765118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:09.774019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48cd09-0f27-431c-94f7-e867b03ece7f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:09.822818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 463/902] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:09.826133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:09.826854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.827202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.827548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:09.829804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:09.830646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:09.840362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:09.841805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:09.842679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 440/903] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:09.847239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:09.956921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279094b-a99c-4ad4-880f-2b5441525596 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:09.986237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:09.998151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:09.998822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:09.999106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:09.999380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.000022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.000870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.002705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.007912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 464/904] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.016605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.107019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.123194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f332b6e-4cd3-4482-a12c-5f7dc5a6a766 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.174452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.175109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.175385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.175703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.176365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.176665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.178597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.191799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 441/905] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.193005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.217694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:10.237855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118acd4d-0478-4ecb-9175-242929ce0ec7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.292603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.293268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.293551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.293820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.294851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.296649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:10.308749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:10.309761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:10.310646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:10.315263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 465/906] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:10.316149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.326716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d512c7f-b86b-4184-846c-85b477dea7dd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.369305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.369845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.370121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.370387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.371090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] RBAC: Adding query filter params (interface=public, service_id=ae9e7dddfa424deca22190d1dcc7bca3, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.371396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.373430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.385643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 442/907] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/endpoints?service_id=ae9e7dddfa424deca22190d1dcc7bca3&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.387068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:10.387945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.446830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8064d-3e17-4425-9101-83dd772ef563 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.476983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:10.486258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.487010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.487354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.487717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.488777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.489046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.490514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.497559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410717a4-5293-400f-a1d6-ab7ed21527a3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.500068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 466/908] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.501948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.534175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.535322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.536029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.536459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.537615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.539698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.547548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 443/909] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:52:10.621756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b85dd-8a39-4b2c-827e-3cabe985d66e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.640721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:10.660676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.661292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.661569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.661840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.662732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.663031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.664439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.670135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 467/910] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.677390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.790476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35d4e-697e-4a0a-b6a6-055ef961cbe8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.826207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.826820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.827138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.827412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.828132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] RBAC: Adding query filter params (interface=public, service_id=ff12d1dc56a24d4f8932e05353e8882e, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:10.828590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.830060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea868d2-97c2-4d56-a647-6730cb8fd81f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:10.835412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 444/911] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/endpoints?service_id=ff12d1dc56a24d4f8932e05353e8882e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:10.841047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:10.955320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1820d3-783e-4b19-b371-3228f2267d42 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:10.990890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:10.991555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:10.991839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:10.992142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:10.992791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:10.994151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ba4b2-64d9-4b44-a7f7-6c12ad30a8fe None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:11.000667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 468/912] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:10 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:52:11.691302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084054b8-139e-45b4-aa3c-548774a6e77c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:11.691850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084054b8-139e-45b4-aa3c-548774a6e77c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:11.691850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084054b8-139e-45b4-aa3c-548774a6e77c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:11.693479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 445/913] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:11.698792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f94d-461e-422c-958c-f7f918e55d67 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:11.699231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f94d-461e-422c-958c-f7f918e55d67 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:11.699678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f94d-461e-422c-958c-f7f918e55d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:11.718612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b060f94d-461e-422c-958c-f7f918e55d67 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:11.720386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b060f94d-461e-422c-958c-f7f918e55d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:11.757271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:11.804125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 469/914] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:11.923503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b59b-7a83-4029-b5b8-8a42da14bc8d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:11.923838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b59b-7a83-4029-b5b8-8a42da14bc8d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:11.924172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b59b-7a83-4029-b5b8-8a42da14bc8d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:11.925555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 446/915] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:11.931088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:11.931835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:11.931835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:11.951879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:11.952646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:12.023132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 470/916] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:12.110514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b59b-7a83-4029-b5b8-8a42da14bc8d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.124470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.221563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b59b-7a83-4029-b5b8-8a42da14bc8d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.256811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.257504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.257781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.258050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.276913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:12.282451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:12.283589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:12.284826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 447/917] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:12.291742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.292529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.375727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.417630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffed1e-e48f-4873-b9b5-d49ac9386040 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.418187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed403-5a4e-4574-8128-818c41c99d8a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.420360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.453714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.454350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.454686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.454954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.455747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:12.456082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.457545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.463619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.464569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.465049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.465493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.468009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 448/918] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:12.468572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.470100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.472986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:12.480780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:12.481784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:12.482619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 471/919] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:12.489656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.602264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2152cd-5808-416a-84ea-71c4057cb70c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.605807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f275-5c5a-4b04-b8be-43c1f43d51f5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.635856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.642353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.642746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.643443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.643684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.643798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.643992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.650014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.650141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:12.650229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.650302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.650302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.656139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 472/920] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:12.657481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.661249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.664130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:12.682927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:12.683937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:12.684947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:12.684947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:12.684947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:12.684947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 449/921] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:12.690679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.702284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.801603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd715b1a-8644-4d1e-9a4b-6e0d396d22f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.809959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca80-d29d-4a80-807a-b5d682a8446e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.846322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.846936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.847214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.847486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.848157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:12.848459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.849904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.859636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 473/922] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:12.860740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:12.861034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.862043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:12.862554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:12.863062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:12.864145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:12.865573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:12.867165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:12.886337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 450/923] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:12.887644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:12.937435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.968679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:12.975850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b762-363d-4b9b-8702-3bf79e395288 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:12.996207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a73b1-557d-4e52-9e61-33ec53062367 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.017289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.018635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.019102 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.019567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.020621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] RBAC: Adding query filter params (interface=public, service_id=d19c9f56fa654fe7b47d96e48c1f21f9, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:13.021437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.023260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7fd25-2925-46df-a13b-a1ce7614f94e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.029433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 474/924] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/endpoints?service_id=d19c9f56fa654fe7b47d96e48c1f21f9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:13.030703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896079-d367-41e1-9f83-1b8054d7faa0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.031045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896079-d367-41e1-9f83-1b8054d7faa0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.031532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896079-d367-41e1-9f83-1b8054d7faa0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.036915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 475/925] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:13.036915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896079-d367-41e1-9f83-1b8054d7faa0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.040073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.040804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.041081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.041351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.050147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.051590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-2587cbf5-fe11-4b1a-ad30-7a0e324f4929 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:13.064671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:13.065636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:13.066595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 451/926] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:52:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:13.067220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.067220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.067354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.087038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:13.088426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:13.155180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896079-d367-41e1-9f83-1b8054d7faa0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.163191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 452/927] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:13.164298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.203533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.204183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.204466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.204741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.205348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.207408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d8d50-8c4b-40f6-a617-42843442e062 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.211121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.215832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 476/928] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:52:13.313835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e54db-f297-499b-8d9a-eee6ef9fe2a0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.348506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3396-b758-4294-aff6-9883ca42202c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.348704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3396-b758-4294-aff6-9883ca42202c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.348968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d3396-b758-4294-aff6-9883ca42202c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.350613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 477/929] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:13.354581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.355446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.355908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.356042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.356269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.356549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.356896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.357888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:13.358391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.360642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.376353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:13.377577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:13.388230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 453/930] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:13.390222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.397193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.462070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 478/931] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:13.490057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.501946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.511156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe279-d8bb-4c27-a6ed-6b477e88b8a0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.558408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.559388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.560021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.560491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.571247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.572998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:13.589207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:13.590212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:13.591105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:13.591105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:13.591105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:13.593214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 454/932] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:13.599754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.609164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82bc1c-d9e5-4e68-923a-c3c8b08a6fbf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.646541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.647167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.647442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.647709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.648491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.649847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:13.660449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:13.661507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 07:52:13.662619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:13.666749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 479/933] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:13.667601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.691570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.730236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c19dd-5fbd-4948-a007-55ed07e09f06 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.765556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.766253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.766807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.767448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:13.767747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.769145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.786564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 455/934] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:13.786564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.788435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.794832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae220d7d-b504-4ff9-aa6e-6bb0db103f98 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.832338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.832974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.833217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.833490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.834121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:13.834421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.835770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.840879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 480/935] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:13.841726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.893505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcd56-2a5b-4519-b025-8c58512562e1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.926712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.927962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.927962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.927962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.928449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.929814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:13.930461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:13.939285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:13.940339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:13.941232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 456/936] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:13.942573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:13.954484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f109-bf5c-4730-adee-fd9fa744fd32 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:13.989172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:13.989805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:13.990057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:13.990326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:13.997129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:13.998547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:14.012013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:14.013119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 481/937] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:14.014014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.027863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:14.064595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f947-f343-42d6-a9cd-9a93dbe92abb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.101160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.102070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.102537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.102769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.103387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:14.103691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.105090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.114909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 457/938] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Sep 13 07:52:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:14.114909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.128594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fcc6d-f307-468e-b753-cdccf3e83978 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.167309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.167843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.168160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.168437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.169062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:14.169367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.170722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.176476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 482/939] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:14.177298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.182290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:14.223156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a37d-db20-4ab9-aa96-f0527493e248 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.254741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:14.269982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.270887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.271171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.271451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.272198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:14.272509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.273946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.293170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 458/940] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:14.293170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.293439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da926-ff35-4552-a30d-b99e9a6faa00 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.330327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.331218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.331495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.331763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.332457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.333808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.390157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20832-d952-4ede-a2f9-a678247ffdbb None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.415821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 483/941] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:14.416879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.444083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.445107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.445392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.445724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.446377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:14.446688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.448221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.461350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 459/942] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:14.462718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:14.497140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:14.546263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23803c76-dea3-40c7-a27e-993a92b4f66f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.551219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:14.585594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.586336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.586648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.586887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/1a0ea18309fb47cfa5efe4f6f95beec6/roles/47b78af1eb9840c2965c5cd176969e3a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.589334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=1a0ea18309fb47cfa5efe4f6f95beec6, role_id=47b78af1eb9840c2965c5cd176969e3a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.590753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d5564-09f1-4c20-ab90-84f081a371f0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.610520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25812e1-def3-4775-b7c6-eb6bc744e5b7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:14.648795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:14.649408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:14.649688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:14.649960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:14.650627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:14.652039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6257c4-a3c0-4fd6-9084-9b281e5bcac0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:14.679252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 484/943] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:52:14 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/1a0ea18309fb47cfa5efe4f6f95beec6/roles/47b78af1eb9840c2965c5cd176969e3a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:52:14.764631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 460/944] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:15.480570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947372e9-f944-41b1-9c8b-8c68f35291fe None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:15.481080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947372e9-f944-41b1-9c8b-8c68f35291fe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:15.481080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947372e9-f944-41b1-9c8b-8c68f35291fe None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:15.482672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 485/945] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:15.488659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:15.489083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:15.489252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:15.507721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:15.508951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:15.590073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 461/946] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:15.861471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947372e9-f944-41b1-9c8b-8c68f35291fe None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:15.966093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947372e9-f944-41b1-9c8b-8c68f35291fe None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:15.989828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:16.004309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:16.004946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.005226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.005499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.006081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:16.007530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:16.016474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:16.017467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:16.018309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 486/947] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:16.024048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:16.060659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:16.133192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52767994-71c6-4552-8856-6efb42bd6075 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:16.185890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:16.186981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.188046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.188532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.189368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:16.189876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:16.191491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:16.196888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 462/948] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:16.202753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:16.320426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965efb-5104-4858-9b88-8c33b9ebe875 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:16.354874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:16.355484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.355766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.356063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.356687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:16.356990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:16.358341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31626195-9ec1-49ab-b48d-a870588b06f0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:16.364005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 487/949] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:16.369500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:16.482091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:16.486996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4e598-aa25-405a-9b4c-ffbf4f58973a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:16.524112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:16.525516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.526031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.526498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.527393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:16.528984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf9341-144e-4769-8d14-a822a01928bb None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:16.610515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 463/950] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:16.796555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0bf0-962b-4fdc-9080-692673900f42 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.797724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0bf0-962b-4fdc-9080-692673900f42 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.797813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc0bf0-962b-4fdc-9080-692673900f42 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.799645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 488/951] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:16.806722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05685b-2127-4473-9ce0-b1520c3647b0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.807198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05685b-2127-4473-9ce0-b1520c3647b0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.807686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05685b-2127-4473-9ce0-b1520c3647b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.834190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bc05685b-2127-4473-9ce0-b1520c3647b0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:16.836244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bc05685b-2127-4473-9ce0-b1520c3647b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:16.916977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 464/952] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:16.923677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f22f-12d4-4fc9-b19e-28fbc116a69e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.924244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f22f-12d4-4fc9-b19e-28fbc116a69e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.924736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f22f-12d4-4fc9-b19e-28fbc116a69e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.930198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 489/953] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:16.932239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e3f4-1088-4ef1-bb4c-2e0ddb180a6d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:16.932691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e3f4-1088-4ef1-bb4c-2e0ddb180a6d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:16.933121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573e3f4-1088-4ef1-bb4c-2e0ddb180a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:16.952191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e573e3f4-1088-4ef1-bb4c-2e0ddb180a6d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:16.953927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e573e3f4-1088-4ef1-bb4c-2e0ddb180a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:17.029424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 465/954] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:17.126839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc06caf-23e1-483a-b2d5-c53464515d3d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.127352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc06caf-23e1-483a-b2d5-c53464515d3d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.127840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc06caf-23e1-483a-b2d5-c53464515d3d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.129699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 490/955] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:17.138961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.139249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.139523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.160653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:17.161860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:17.166107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.225718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc06caf-23e1-483a-b2d5-c53464515d3d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.236862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 466/956] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:17.283403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.334101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.336602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc06caf-23e1-483a-b2d5-c53464515d3d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.372605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.373216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.373496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.373768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.374413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.376806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:17.379325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING keystone.server.flask.common [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 07:52:17.427235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.sql.core [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 07:52:17.427235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 07:52:17.427235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [parameters: {'id': '947fa8b08b5a4fb6827fa8769522e409', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 07:52:17.427235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81519) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 947fa8b08b5a4fb6827fa8769522e409.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 947fa8b08b5a4fb6827fa8769522e409. Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:52:17.445768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application result.read() Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 07:52:17.446664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application yield resource Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise self.value Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application session.commit() Sep 13 07:52:17.447656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.session.flush() Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application compat.raise_( Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 07:52:17.448642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 07:52:17.449714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application result.read() Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:52:17.450534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [parameters: {'id': '947fa8b08b5a4fb6827fa8769522e409', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.451426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:17.454616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 947fa8b08b5a4fb6827fa8769522e409. Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 491/957] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Sep 13 07:52:17 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:17.457163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.466926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d29e-86b4-441f-abbd-4db9367978f4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.508273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.508912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.509192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.509466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.517538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.521109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:17.526209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:17.527644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 467/958] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:17.529063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.584154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1da156-8e7c-413a-9182-094e095646b6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.586611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.624348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.625012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.625928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.626209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.633027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.634605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:17.639235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd887b-d854-4020-929d-39dd98909b6f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:17.646189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:17.647317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 492/959] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:17.648695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.680972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.681607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.681892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.682168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.682766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.684157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:17.693804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:17.699918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:17.700985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 468/960] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:17.701961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.766471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fe2d-e198-4529-a985-b109f034773a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.769938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.802796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.803569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.804201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.804484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.805295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:17.805602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.806967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:17.809506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79578596-cf12-4299-94d6-3b5adff57cf5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.818584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 493/961] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:17.819203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.847806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:17.851540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.852181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.852461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.852731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.853387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:17.853688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.855116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:17.873809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 469/962] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:17.874410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:17.943950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25843136-236c-4f9a-8f33-5079b5a76cdd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:17.988513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:17.989567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:17.990054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:17.990923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:17.992105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:17.992664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:17.994660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.006243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 494/963] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:18.007529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:18.020508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a657d-7fe0-4d65-b37a-fe963f761dd6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.050238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:18.064597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.066013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.066847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.067305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.081859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.084163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:18.099714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:18.100726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:18.101613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:18.101613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:18.101613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:18.103720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 470/964] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:18.111775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:18.126879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:18.134652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d503363-be19-4778-859e-c1e44f94a535 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.183417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.184085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.184374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.184650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.185301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:18.185718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.186938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.196695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 495/965] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:18.236927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4ee5-1729-44a3-bb82-c574ff3f5c4c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.281113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.282944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.283233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.283514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.284209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:18.284519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.286052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.301510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 471/966] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:18.309177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:18.432703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f09ad9-d7f5-402c-ab1e-45005a1b077f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.469934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.470503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.470781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.471055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.479298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.480756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:18.493660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:18.494663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:18.496401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 496/967] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:52:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:18.502230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:18.539874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:18.610791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba752b2-26b8-4c75-8be7-91d3d016b3f6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.647267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.647888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.648203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.648481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.649205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:18.649515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.650941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325087c1-dac2-4536-8c1f-b2e9af1fc538 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.671017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 472/968] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Sep 13 07:52:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:18.676979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:18.695263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:18.785109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df374-87f8-4053-a31a-bd92823378c9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:18.841917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:18.842554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.842806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.843081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.928349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:18.935061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:18.947505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:18.993328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888dfd-45fc-427d-bc7f-cee480df33d8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:18.993646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888dfd-45fc-427d-bc7f-cee480df33d8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:18.993881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7888dfd-45fc-427d-bc7f-cee480df33d8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:18.995620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 473/969] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:19.001252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.001534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.001811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.022957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:19.024238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:19.042920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 497/970] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:18 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:19.049405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.119905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 474/971] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:19.170035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662a07-3c50-475b-a9d1-4e7f8017ab13 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.185382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.206533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.207208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.207486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.207761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.218103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.220790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:19.243883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:19.245165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:19.246550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:19.246550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:19.246550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:19.246550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 498/972] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:19.251854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.280001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.361901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b382-54f1-40bf-bc18-903e58998a72 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.402571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.403183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.403463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.403735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.404408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:19.404712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.406192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.419463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 475/973] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:19.425852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.427127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.535064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.553088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fb58-addc-485f-94ad-b8bb28d020d7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.566680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406494d4-67b7-4d22-81db-c6cb49f04d2a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.590635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.591606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.592169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.592740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.593551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.596201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.605032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.605666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.605949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.606227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:19.606747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:19.607742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:19.608647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:19.616253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.616253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.616746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 476/974] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:19.617915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:19.627559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:19.628707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:19.629617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 499/975] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:19.634759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.665927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.734540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555420c1-d74a-4c1a-98c1-660db8ca8da9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.751360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4455e-eaae-4f0f-a0ab-fa2631d36230 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.773561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.774538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.775081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.775584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.776438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:19.776940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.778514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.784519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 477/976] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:19.792537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.792537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.792787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.793000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.793724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:19.794034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.794590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.795455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.809362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 500/977] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:19.815180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.817347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.921088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e9eb-2472-452e-a1ab-8a18a0369faf None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.922232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:19.940043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec7cd-b40f-409f-a329-edf0f435d847 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:19.958657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.959274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.959558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.959831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.960607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:19.960918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.962407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:19.972742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 478/978] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:19.974702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:19.989073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:19.989393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:19.989393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:19.991484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:19.991484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] RBAC: Adding query filter params (role.id=47b78af1eb9840c2965c5cd176969e3a, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=1a0ea18309fb47cfa5efe4f6f95beec6) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:19.991484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:19.994447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:20.004076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 501/979] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/role_assignments?user.id=1a0ea18309fb47cfa5efe4f6f95beec6&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=47b78af1eb9840c2965c5cd176969e3a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:20.076813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:20.104076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57be4-56f1-4bcf-92b2-368138301d8f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:20.150079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:20.150706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.150986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.151260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.152009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] RBAC: Adding query filter params (interface=admin, service_id=d19c9f56fa654fe7b47d96e48c1f21f9, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:20.152322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:20.153709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e188f-550a-430e-887c-5d35d8969aaf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:20.160642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 479/980] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Sep 13 07:52:19 2022] GET /identity/v3/endpoints?service_id=d19c9f56fa654fe7b47d96e48c1f21f9&interface=admin®ion_id=RegionOne => generated 193 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:20.169461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:20.228286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99fda-8837-4ae3-b201-63ffd6201bd0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.228582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99fda-8837-4ae3-b201-63ffd6201bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.228764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99fda-8837-4ae3-b201-63ffd6201bd0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.230394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 480/981] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:20.235720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630e74-ff07-4f3f-920e-5b8fab22cff7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.236018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630e74-ff07-4f3f-920e-5b8fab22cff7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.236300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630e74-ff07-4f3f-920e-5b8fab22cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.260412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f630e74-ff07-4f3f-920e-5b8fab22cff7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:20.260412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f630e74-ff07-4f3f-920e-5b8fab22cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:20.297909 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00df9a-129e-440c-9efe-72e0e20a6691 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:20.345605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:20.345816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 481/982] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:20.346214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.346546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.346824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.347472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:20.348860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb7fd3-e8bb-4b24-bae6-4957f50a013c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:20.355324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 502/983] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:20 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:52:20.588841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a2b0-6fdc-491b-b95c-b01bd162eefc None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.589400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a2b0-6fdc-491b-b95c-b01bd162eefc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.589400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a2b0-6fdc-491b-b95c-b01bd162eefc None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.590958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 482/984] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:20.596921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.597203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.597468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.616640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:20.618464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:20.620895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a2b0-6fdc-491b-b95c-b01bd162eefc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:20.630177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:20.704017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 503/985] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:20.707532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:20.741093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a2b0-6fdc-491b-b95c-b01bd162eefc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:20.776158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:20.776767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:20.777047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:20.777323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:20.777988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:20.779418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:20.782501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING keystone.server.flask.common [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 07:52:20.860076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.sql.core [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 07:52:20.860076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 07:52:20.860076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [parameters: {'user_id': 'c8f02369f9af4d5abdd797c1a5aea51b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 07:52:20.860076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81518) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Sep 13 07:52:20.867091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:52:20.868197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application yield resource Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application next(self.gen) Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise self.value Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application session.commit() Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 07:52:20.869396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.session.flush() Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application compat.raise_( Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 07:52:20.870448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 07:52:20.871324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application conn.query(q) Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application result.read() Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 07:52:20.872432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c8f02369f9af4d5abdd797c1a5aea51b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:20.873454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 07:52:20.874493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:20.875992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 483/986] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Sep 13 07:52:20 2022] POST /identity/v3/users => generated 160 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:20.876467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:20.987369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f39cf-c412-4c08-a95e-50dcc0f318ed None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:21.010920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:21.025224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:21.025987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:21.026274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:21.026547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:21.035993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:21.037829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:21.050936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:21.053166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 07:52:21.055670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:21.057050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 504/987] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:52:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:21.064017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:21.064017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:21.126570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fd0d2-a2af-4609-a0eb-a1a344db74f8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:21.157180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:21.162408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:21.163108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:21.163464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:21.163802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:21.164565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:21.166196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba947-5377-4ea2-aa7e-ca586bb58682 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:21.178636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7c7d-528a-49a6-bcee-c9886b52d030 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:21.214638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:21.215244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:21.215526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:21.215797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:21.216516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:21.216821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:21.218360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75b175-819b-4bfb-9c1e-5949d23f59f9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:21.259405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 484/988] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:21 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:21.264184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 505/989] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Sep 13 07:52:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:22.363801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7fe51-9f30-4342-9843-c74976e9d906 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:22.364489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7fe51-9f30-4342-9843-c74976e9d906 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:22.364489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7fe51-9f30-4342-9843-c74976e9d906 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:22.365806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 485/990] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:22.370987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330a3e0-770f-4c86-8d84-d35a14206628 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:22.371398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330a3e0-770f-4c86-8d84-d35a14206628 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:22.371581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330a3e0-770f-4c86-8d84-d35a14206628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:22.389633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1330a3e0-770f-4c86-8d84-d35a14206628 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:22.391415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1330a3e0-770f-4c86-8d84-d35a14206628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:22.448432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:22.465789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 506/991] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:22.594212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a9f3-f4ff-4616-aeac-1d1762a5df60 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:22.594572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a9f3-f4ff-4616-aeac-1d1762a5df60 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:22.594770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a9f3-f4ff-4616-aeac-1d1762a5df60 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:22.596267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 486/992] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:22.601262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:22.601550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:22.601824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:22.619817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:22.621016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:22.687207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 507/993] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:22.735711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a9f3-f4ff-4616-aeac-1d1762a5df60 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:22.837151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a9f3-f4ff-4616-aeac-1d1762a5df60 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:22.870637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:22.871200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:22.871484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:22.871759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] PATH_INFO: `/v3/services/image` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:22.872369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:22.873732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:22.883201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:22.884219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:22.885150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:22.888295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 487/994] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 07:52:22 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:22.890132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:22.954036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:22.991544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018bd90-2246-432b-9207-47add3cf3de2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.008613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:23.014714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:23.026623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.027239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.027519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.027793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.028449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:23.028763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.030134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.039744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 508/995] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:23.040674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:23.060043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340c7-18d1-44ee-9dfb-5edb143563cf None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.107400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.108059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.108337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.108606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.109752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.111167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:23.120149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:23.121235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:23.122163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 488/996] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Sep 13 07:52:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:23.128850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:23.175466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801612c-1a37-4124-8675-7280456d55a5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.211734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.212364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.212643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.212914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.213536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] RBAC: Adding query filter params (type=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:23.213837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.215186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.220440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 509/997] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:23.246320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84202f11-63ed-4d97-a99d-f744f35f202d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.274355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:23.297736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.298364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.298644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.298916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.299564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:23.299874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.301333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.307278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 489/998] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:23.313880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:23.366109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:23.430438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc57ad3-f6db-4edd-85ea-c92a1de643ae None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.472343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.472953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.473231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.473498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.474119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:23.474418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.475774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e2909-a987-4c59-9bd4-f7178e4973e2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.480708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 510/999] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Sep 13 07:52:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:23.486561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:23.529127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cc3e-82e6-4f1e-af8e-78c87bcfd2e2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.529451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cc3e-82e6-4f1e-af8e-78c87bcfd2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.529678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cc3e-82e6-4f1e-af8e-78c87bcfd2e2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.531203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 511/1000] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:23.536164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.536449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.536721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.554537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:23.555702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:23.594855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3cfb-f38a-4ee3-ac78-5c46cf5d5907 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:23.624022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 512/1001] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:23.635238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:23.636104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:23.636582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:23.637057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:23.637926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:23.639537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:23.701119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 490/1002] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:23.892250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:23.936131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:23.995484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09c496-47a1-422e-a672-3fb405399384 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:24.035121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:24.035763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:24.036070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:24.036346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:24.036920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:24.038549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:24.048030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:24.049087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:24.049935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 513/1003] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:24.056705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:24.103462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:24.164147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9518-70cb-4760-827f-034da8e437dd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:24.199012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:24.199629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:24.199908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:24.200208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:24.200843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:24.201149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:24.202512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:24.207646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 491/1004] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:24.213261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:24.320967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:24.324321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73b54c-2c68-411f-81e0-b17c02e086e8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:24.358678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:24.359336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:24.359618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:24.360019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:24.360654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:24.360957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:24.362316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:24.372007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 514/1005] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:24.373549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:24.477393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4314d-e16f-40b7-89a0-275b8b983e52 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:24.487252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:24.514195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:24.514804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:24.515085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:24.515378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:24.516102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] RBAC: Adding query filter params (interface=public, service_id=6b130971212f49e89b558ee09609113a, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:24.516413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:24.517779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c6a8-f272-480a-b596-bf7b96a18379 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:24.527589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 492/1006] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:52:24 2022] GET /identity/v3/endpoints?service_id=6b130971212f49e89b558ee09609113a&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:24.529184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:24.633452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3fb8-6552-4929-990b-c5a8a463ac35 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:24.666369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:24.666971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:24.667259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:24.667536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:24.668173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:24.669539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c00d81-fda3-445b-bd1f-50cf762e13f6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:24.684077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 515/1007] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:24 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:52:25.498495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b74-d537-4d63-8902-6f84dfabc41c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:25.499056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b74-d537-4d63-8902-6f84dfabc41c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:25.499056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7b74-d537-4d63-8902-6f84dfabc41c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:25.501893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 493/1008] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:25.507123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d380-b004-4e30-a7b6-cab05fcff4cd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:25.507552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d380-b004-4e30-a7b6-cab05fcff4cd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:25.507832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d380-b004-4e30-a7b6-cab05fcff4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:25.526045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-83a3d380-b004-4e30-a7b6-cab05fcff4cd None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:25.527141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-83a3d380-b004-4e30-a7b6-cab05fcff4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:25.551729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:25.604005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 516/1009] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:25.866160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7b74-d537-4d63-8902-6f84dfabc41c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:25.886727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8a4f-d4a3-4e89-98b8-50f4cb6bf212 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:25.887049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8a4f-d4a3-4e89-98b8-50f4cb6bf212 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:25.887280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b8a4f-d4a3-4e89-98b8-50f4cb6bf212 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:25.888788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 517/1010] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:25.893782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:25.894066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:25.894343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:25.914759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:25.915951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:25.980068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7b74-d537-4d63-8902-6f84dfabc41c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:25.993086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 518/1011] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:26.013972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:26.014581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:26.014920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:26.015197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:26.016417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:26.017777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:26.084032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 494/1012] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:25 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:26.266036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:26.359576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:26.371362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911018-3d41-420f-b7e6-6abea54f906e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:26.412511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:26.413142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:26.413418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:26.413682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:26.414771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:26.416224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f46737-5150-4e53-b8da-ba1d57c060ff None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:26.417780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 519/1013] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:26.423632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:26.457888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:26.528204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a219-41df-452c-9aec-a5ef4ac57b4b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:26.562854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:26.563489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:26.563768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:26.564068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:26.564728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:26.566156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098b82-51f4-4733-93e4-33aadf72d1ac None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:26.633163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 495/1014] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:26 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:26.882646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4975-c8a5-45b5-be95-b92d9e41e993 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:26.883640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4975-c8a5-45b5-be95-b92d9e41e993 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:26.884171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4975-c8a5-45b5-be95-b92d9e41e993 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:26.885716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 520/1015] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:26.891674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:26.891964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:26.892267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:26.911510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:26.913316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:26.982557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 496/1016] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:27.257049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4975-c8a5-45b5-be95-b92d9e41e993 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:27.369769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4975-c8a5-45b5-be95-b92d9e41e993 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:27.403415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:27.404066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:27.404347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:27.404619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:27.405306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:27.407240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:27.416382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:27.417409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 07:52:27.418246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:27.420373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 521/1017] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:27.424120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:27.440662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:27.526640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2911-896b-4fa3-9232-8c660ad38199 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:27.560651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:27.561276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:27.561520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:27.561797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:27.562488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:27.562857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:27.564285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:27.573977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 497/1018] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:27.575273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:27.597402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:27.680331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75644c80-7bbf-46e8-baa4-162d0ac322e4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:27.714831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:27.715441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:27.715720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:27.716010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:27.716632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:27.716933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:27.718275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334bf-a487-4c5a-ada3-6610cc887cd5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:27.728238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 522/1019] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Sep 13 07:52:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:27.729312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:27.811758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:27.834364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93931c8-2624-44b3-bcac-89fea493980b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:27.869208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:27.869813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:27.870088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:27.870356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:27.871012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:27.872396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9b37-ac64-4c60-95fb-93c51d8fd1d4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:27.929350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 498/1020] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:52:28.315613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf4c5-8771-4a29-86d4-a0c2a58ee354 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:28.316219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf4c5-8771-4a29-86d4-a0c2a58ee354 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:28.316219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf4c5-8771-4a29-86d4-a0c2a58ee354 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:28.317690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 523/1021] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:28.323030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:28.323323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:28.323602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:28.342334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:28.344111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:28.419200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 499/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:28.689231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf4c5-8771-4a29-86d4-a0c2a58ee354 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:28.778137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:28.799528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf4c5-8771-4a29-86d4-a0c2a58ee354 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:28.833041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:28.833676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:28.833957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:28.834229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] PATH_INFO: `/v3/services/image` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:28.834810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:28.836189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b1652980-9444-43cd-8abc-3bb33ca1be94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:28.845619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:28.846651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:28.847508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:28.851677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 524/1023] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 07:52:28 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:28.853055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:28.862521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e976c6-324e-4cfe-9a39-61d35b479ab0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:28.862802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e976c6-324e-4cfe-9a39-61d35b479ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:28.863074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e976c6-324e-4cfe-9a39-61d35b479ab0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:28.864422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 525/1024] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:28.869440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:28.869728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:28.870006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:28.887594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:28.888790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:28.918008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:28.960725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 526/1025] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:28.966952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93267d4-ff15-4745-a321-8cfc7935156e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.003599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.004236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.004520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.004791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.005418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] RBAC: Adding query filter params (name=image) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:29.005722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.007085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.016809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 500/1026] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:29.017673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:29.094665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:29.119632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b82a3-4103-496d-828f-b4e1fcf36376 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.153109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.153717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.153996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.154268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.154888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] RBAC: Adding query filter params (type=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:29.155190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.157274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.162479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 527/1027] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:29.168346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:29.246093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:29.277778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a41e8-83b6-421e-ad66-3277f13ebf3c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.304591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:29.316167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.316791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.317072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.317518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.318024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] RBAC: Adding query filter params (interface=public, service_id=0317dd36a3d44d8eb6541e64935fa9ec, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:29.318332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.319683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.324917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 501/1028] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:52:29 2022] GET /identity/v3/endpoints?service_id=0317dd36a3d44d8eb6541e64935fa9ec&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:29.331485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:29.365611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a84d-dbe7-47c5-aa02-6649988aa969 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.405408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.406714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.407204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.407697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.409197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.410626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.416012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 528/1029] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:29.417873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:29.426602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:29.444514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52043a76-4ba2-46f3-8d71-803b05986a1a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.483807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.484653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.484837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.485067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.485663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.487017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795af9a-370f-4a6d-933b-763fb782c5d4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.493389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 502/1030] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:52:29 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:52:29.525666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f3d6-6093-4c09-a5fb-f6694d08bd89 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:29.564611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:29.565292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:29.565573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:29.565842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:29.566499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:29.567943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82373-2b30-4601-abfa-ec10229e0334 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:29.644914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 529/1031] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:52:29 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:30.236806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1dbf-3dd3-4c11-a82a-1a31b70433a0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:30.237354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1dbf-3dd3-4c11-a82a-1a31b70433a0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:30.237354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1dbf-3dd3-4c11-a82a-1a31b70433a0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:30.238882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 503/1032] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:30.243882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:30.244211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:30.244490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:30.264289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:30.266052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:30.323807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:30.334388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 530/1033] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:30.605740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d1dbf-3dd3-4c11-a82a-1a31b70433a0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:30.661700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:30.709307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d1dbf-3dd3-4c11-a82a-1a31b70433a0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:30.746291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:30.747230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:30.747695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:30.748179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:30.758768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:30.763740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:30.764803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:30.766532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:30.768443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 504/1034] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:30.777288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:30.878425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd930-8a0b-4df4-9fb5-cbcd3e36c0ee None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:30.911922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:30.912817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:30.913096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:30.913369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:30.914023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:30.914326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:30.915681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:30.929132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 531/1035] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:30.930710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.030641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613f8f3-1e87-41e6-b0e0-6427ef8c7d5e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:31.044585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:31.065819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:31.066445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.066723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.066992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.077083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:31.078770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:31.094103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:31.095261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:31.096621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:31.096621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:31.096621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:31.099884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 505/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:31.101239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.160869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:31.208792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6297-058e-483e-a55d-2fb058ea918f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:31.242825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:31.243434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.243770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.244076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.244713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:31.245019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:31.246373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:31.258926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 532/1037] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:31.264634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.369161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6e3ae-a22b-4b4e-8d4a-612100a23daa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:31.403458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:31.404124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.404413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.404685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.412959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:31.414335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:31.426199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:31.427171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:31.428548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:31.432054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 506/1038] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:52:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:31.433540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.538204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f698d-587a-4eb7-9a7e-558b18c5e4ba None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:31.552883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:31.572965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:31.573571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.573851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.574124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.574854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:31.575160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:31.576638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808e88-45b7-4641-8193-84f1f5e70581 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:31.602207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 533/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:52:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:31.603596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.632134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:31.705148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c65dc2-616c-4234-ba3a-a7a80c94d3b2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.705354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c65dc2-616c-4234-ba3a-a7a80c94d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.705603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c65dc2-616c-4234-ba3a-a7a80c94d3b2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.706929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 534/1040] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:31.711019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5f4fc-8223-4dfc-be82-37bd5a1eca90 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:31.711901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebffc-83b9-4f3c-b952-ff04822652c3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.712222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebffc-83b9-4f3c-b952-ff04822652c3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.712759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bebffc-83b9-4f3c-b952-ff04822652c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.736088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c1bebffc-83b9-4f3c-b952-ff04822652c3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:31.737276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c1bebffc-83b9-4f3c-b952-ff04822652c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:31.747556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:31.748201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.748480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.748772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.820036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 535/1041] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:31.828772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:31.830342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:31.855156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:31.912483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f111f6-0a7e-4613-aad5-d4d70f2ceb25 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.912767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f111f6-0a7e-4613-aad5-d4d70f2ceb25 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.913040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f111f6-0a7e-4613-aad5-d4d70f2ceb25 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.914513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 536/1042] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:52:31.919318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:31.919602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:31.919877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:31.934002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 507/1043] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:31.939075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:31.940118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:31.940244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:32.016815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 537/1044] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:32.040215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92e816-e273-4616-814e-f43c067184c7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.065217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.075770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.076434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.076714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.076990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.083928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.086867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.088350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:32.104269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:32.105262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:32.106539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:32.106539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:32.106539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:32.106539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 508/1045] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:32.111597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.117287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.190182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5819-04b7-4a04-9805-56faf16d6f7c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.225902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec6453-3537-4085-8b18-dd41b7c64daa None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.227439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.228095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.228376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.228646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.229224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.230572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:32.240269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:32.241416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:32.242254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 538/1046] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:32.247042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.276403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.276952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.277233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.277671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.278615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:32.279034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.280330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.295568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 509/1047] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:32.296260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.331950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.344917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.351042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58414a1e-68aa-4a96-91a2-ceafb0eacfd0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.384578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.385180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.385461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.385732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.386350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:32.386650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.388026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.393754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 539/1048] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:32.394519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.401123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c412-e221-4672-afde-7090d7acacfc None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.436352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.437495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.437888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.438396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.448412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:32.453268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:32.454223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 510/1049] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:32.455080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.497252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee2faf-b21e-46a7-80e6-fb2e0f0713c6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.533365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.533903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.534178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.534445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.541197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.542623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:32.554309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:32.555460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 540/1050] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:32.556416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.557451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.565490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b88-0bf9-4f70-8cd2-10015904c2c8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.581632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.599366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.599971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.600271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.600539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.601159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] RBAC: Adding query filter params (type=image) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:32.601457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.602812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.607549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 511/1051] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:32.608347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.659004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491df7d-ebe0-45a5-afec-1c8fb4870f5c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.693939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.694553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.694866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.695177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.695874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:32.696291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.697677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.706187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 541/1052] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:32.706593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdba-a3fe-4a1a-a0d9-67efba2fd580 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.706954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.745429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.746038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.746319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.746593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.747281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:32.747587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.749046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.760266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 512/1053] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:32.761047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.783174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.786003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:32.813279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2425c6-b901-4756-b3db-a8ac14d1b117 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.848185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.848867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.849108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.849414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.850099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.851473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.862295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf638e-2470-4e22-b60b-7dc559aeb555 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:32.896415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:32.897033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:32.897319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:32.897590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] PATH_INFO: `/v3/users/914b75f5fd504878ac5edb3a280b9f00` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:32.906767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 542/1054] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:52:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:32.907587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:32.933141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] RBAC: Authorizing `identity:get_user(user_id=914b75f5fd504878ac5edb3a280b9f00)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:32.934726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:32.936538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 513/1055] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/users/914b75f5fd504878ac5edb3a280b9f00 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:32.942522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:33.028095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:33.036890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9ea-b62d-4671-af32-e4c749ab310d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:33.053974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f30e-d0af-43ad-8255-850e644aba5d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:33.080598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:33.081076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:33.081356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:33.083109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:33.083109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] RBAC: Adding query filter params (role.id=47b78af1eb9840c2965c5cd176969e3a, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:33.083109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:33.084120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:33.086187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:33.090551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 543/1056] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=47b78af1eb9840c2965c5cd176969e3a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:33.096818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:33.097524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:33.103959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:33.103959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:33.179124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:33.180636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:33.268527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:33.300127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 514/1057] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 07:52:33.304516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:33.425565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7583840-7fc5-4b4c-a112-bb6b387b35c3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:33.461152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:33.461818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:33.462144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:33.462407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:33.463528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:33.464979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e664df-cc34-4167-afca-6c83cc982603 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:33.472068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 544/1058] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:33 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:33.473068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:33.585158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c382b7-3e81-4a4e-a696-f4e85e2596b0 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:33.624114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:33.625357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:33.625638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:33.625903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:33.626628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=6f775fd51f8a473e8169d400512f0fe5, user.id=914b75f5fd504878ac5edb3a280b9f00) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:33.626934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:33.628480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ab6e1-8081-4845-a791-9708c7f48080 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:33.640356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 515/1059] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:33 2022] GET /identity/v3/role_assignments?user.id=914b75f5fd504878ac5edb3a280b9f00&scope.project.id=6f775fd51f8a473e8169d400512f0fe5&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:35.294759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6bd00-fc2e-4f1e-9fb8-31d6c1899c66 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.295216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6bd00-fc2e-4f1e-9fb8-31d6c1899c66 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.295331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6bd00-fc2e-4f1e-9fb8-31d6c1899c66 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.297469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 545/1060] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:35.302650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4b49-4bb5-4354-80d7-e330c0b9eb0e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.303033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4b49-4bb5-4354-80d7-e330c0b9eb0e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.303209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d4b49-4bb5-4354-80d7-e330c0b9eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.322245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-408d4b49-4bb5-4354-80d7-e330c0b9eb0e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:35.323446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-408d4b49-4bb5-4354-80d7-e330c0b9eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:35.365169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:35.398438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 516/1061] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:35.456772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7079-0271-449c-90ab-5437bb0384b4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.457078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7079-0271-449c-90ab-5437bb0384b4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.457328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7079-0271-449c-90ab-5437bb0384b4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.458805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 546/1062] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:35.463812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.464129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.464410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.483369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:35.485099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:35.553341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 517/1063] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:35.668480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7079-0271-449c-90ab-5437bb0384b4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:35.736550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:35.777130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7079-0271-449c-90ab-5437bb0384b4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:35.811696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:35.812345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.812625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.812895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.830039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:35.880851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:35.882278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611eef0-654c-4231-8dea-23da5e996084 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:35.929944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79881c8-1328-4bc8-87c5-00d559fbfbc7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:35.931432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:35.944481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:35.965218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:35.965894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.966176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.966451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.977283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:35.978664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 547/1064] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:35.979897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31df-218b-4ee4-938a-dca3bfbfeb69 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.980238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31df-218b-4ee4-938a-dca3bfbfeb69 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.980611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31df-218b-4ee4-938a-dca3bfbfeb69 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:35.981952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 548/1065] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:35.982302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:35.984272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:35.985131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 518/1066] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:35.989323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:35.989537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:35.989814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:35.990160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.007899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:36.009103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:36.076120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 549/1067] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:36.076802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.090147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-ca97-4363-a08c-827e339dc893 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.132267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.132899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.133175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.133453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.147436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.149549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:36.167123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:36.168331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:36.174333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:36.174333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:36.174333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:36.174333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 519/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:36.174571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.179847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.185860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd11ea-3cee-4891-87ab-54c8fa818457 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.191156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.222116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.222740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.222998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.223264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.223910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:36.224254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.225599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.239315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 550/1069] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:36.240376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.291516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b5145-277c-4cd8-8db1-c6ce7f40b104 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.337301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.338348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.338632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.339177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.339875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:36.340452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.342529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.350660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8088-0108-4992-baae-5365c4ce126b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.357952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 520/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:36.358800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.388863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.389518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.389785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.390683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.402564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.404057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:36.420728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:36.421795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:36.422694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:36.422694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:36.422694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:36.422694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 551/1071] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:36.428312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.443170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.458695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.487666 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6e014-378f-47e7-a4a7-55262640d3b3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.529138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.529562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.529848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.530125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.543917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f54c52-aa7d-4cbf-8c57-6d6ccf4eaa8b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.544110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:36.549824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:36.550783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:36.552228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 521/1072] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:36.557220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.585079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.585739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.586019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.586294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.587296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:36.587296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.588738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.603319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 552/1073] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:36.608417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.685290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec691c97-3c74-48fb-906d-8e1d2eade3df None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.686475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.718487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd6ad-ed23-49e9-b33b-15a6e12d8064 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.721296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.721911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.722213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.722487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.723145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:36.723453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.724860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.726304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.739153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 522/1074] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:36.740279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.753025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.753672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.753950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.754217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.761059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.762470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:36.773790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:36.780773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 553/1075] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:36.781924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.847707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dabf36-8e75-4b35-ba76-e6da304e86d8 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.878431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdaea6-d576-467d-b887-94a6376816c2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:36.882944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.883600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.883883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.884185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] PATH_INFO: `/v3/users/914b75f5fd504878ac5edb3a280b9f00` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.885316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] RBAC: Authorizing `identity:get_user(user_id=914b75f5fd504878ac5edb3a280b9f00)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.886746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.888362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 523/1076] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/users/914b75f5fd504878ac5edb3a280b9f00 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:36.894527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.907393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.913276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:36.913881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:36.914163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:36.914433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:36.915168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:36.915472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:36.916910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:36.934683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 554/1077] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:36.940805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:36.956098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:36.994430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a3dd-68b7-4213-a7fc-11de2b41f904 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.027638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.028287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.028565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.028837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.029943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.032238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.033866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 524/1078] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:37.040121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:37.041039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e0f1-d80b-4531-96e9-2447ba50ca00 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.075265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.075885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.076187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.076456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.087134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.088613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:37.103089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:37.104108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:37.105031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:37.105031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:37.105031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:37.105031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 555/1079] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:37.110466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:37.145981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3885-1ba9-45b6-aba0-d35edb8b79e4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.159413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:37.175252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:37.180063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.180717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.180998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.181274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5/users/914b75f5fd504878ac5edb3a280b9f00/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.183242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f775fd51f8a473e8169d400512f0fe5, user_id=914b75f5fd504878ac5edb3a280b9f00, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.184777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.216747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3d249-234e-4a0b-9138-dbef1f748657 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.258207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.258813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.259092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.259360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.260005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:37.260318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.261683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.274126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 556/1080] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:37.279725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:37.282982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 525/1081] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:52:37 2022] PUT /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5/users/914b75f5fd504878ac5edb3a280b9f00/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:52:37.388312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:37.391955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c0b7-16fa-4ca9-8dd9-aa9de959cd7e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.435267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.435948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.436264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.436545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.444112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.445570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:37.457822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:37.458931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:37.459840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 557/1082] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:37.464850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:37.565227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dc9f7-f8b4-4665-a2ae-9f98d48de609 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.599546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.600192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.600476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.600750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.601445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:37.601753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.603181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964e3f4-6937-4b7c-9083-70eed88c132c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.615270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 526/1083] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:37.621253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:37.718653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b837e4a-a4ec-4546-94a9-cb449a1fb723 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:37.751664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:37.752354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:37.752633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:37.752904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/47b78af1eb9840c2965c5cd176969e3a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:37.755018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=5f3b6c53dcc844c784c17f6c4af76bfb, role_id=47b78af1eb9840c2965c5cd176969e3a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:37.756475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07034-548d-4cf1-b9d8-29e1b2d66ef2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:37.882762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 558/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:52:37 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/5f3b6c53dcc844c784c17f6c4af76bfb/roles/47b78af1eb9840c2965c5cd176969e3a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:52:39.430534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a17b6-41dd-4cfb-ab67-64ad2ab78267 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:39.431117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a17b6-41dd-4cfb-ab67-64ad2ab78267 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:39.431117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a17b6-41dd-4cfb-ab67-64ad2ab78267 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:39.432474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 527/1085] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:39.438363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:39.438806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:39.438904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:39.457360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:39.458528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:39.473028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:39.525060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 559/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:39.793800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a17b6-41dd-4cfb-ab67-64ad2ab78267 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:39.847819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:39.895278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a17b6-41dd-4cfb-ab67-64ad2ab78267 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:39.931901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:39.932592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:39.932876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:39.933241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:39.945988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3539d39b-4ca2-4016-8300-dd55998a9ea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:39.951069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:39.952432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:52:39.953539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:39.956167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 528/1087] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:39.958681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.045125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132664da-b569-4330-9c53-ba3c6186db40 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.045331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132664da-b569-4330-9c53-ba3c6186db40 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.045611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132664da-b569-4330-9c53-ba3c6186db40 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.047658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 529/1088] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:40.052402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.052690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.052970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.056125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012a725-5a8b-49b7-9577-0c2be6567e3d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.071353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:40.072570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:40.089453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.090061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.090343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.090620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.091271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:40.091576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.093496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.101487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 560/1089] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:40.107461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.123649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.140342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 530/1090] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:40.205386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055484-fd2d-46e0-8c3c-ebe3f51e44c3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.237579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.238195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.238471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.238741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] PATH_INFO: `/v3/users/914b75f5fd504878ac5edb3a280b9f00` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.239851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] RBAC: Authorizing `identity:get_user(user_id=914b75f5fd504878ac5edb3a280b9f00)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.241291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.242840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 561/1091] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/users/914b75f5fd504878ac5edb3a280b9f00 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:40.248684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.295675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.351871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6eec9-e0f6-44ed-8384-8db5aefc823b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.385399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.386001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.386274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.386541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.415023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.454742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.456231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.495476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.496356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.514483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a964-f46f-42e6-8694-074cd8b8bd53 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.547876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.548451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.548726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.548992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.553956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 531/1092] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:40.559862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.561106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:52:40.566194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:40.568135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:40.569213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 562/1093] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:40.573025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.659101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ab37-2696-4893-bdb8-6c96a0a026a5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.671110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac645107-f3b5-4810-be53-9a88d481d3d0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.692806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.693434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.693719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.693995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.695106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.696570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.698353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 532/1094] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:40.704914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.705538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.706145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.706424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.706697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.707532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:40.707838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.710028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.716516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.719379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 563/1095] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:40.724966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.728493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:40.804334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aad8e-eb39-42b7-8ec8-2a5b71cb0444 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.824021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab62bc0-8e29-4a60-9f7a-26c1f4cadd9b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:40.839076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.839689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.839968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.840271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.840995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=6f775fd51f8a473e8169d400512f0fe5, user.id=914b75f5fd504878ac5edb3a280b9f00) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:40.841307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.842742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.849049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 533/1096] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/role_assignments?user.id=914b75f5fd504878ac5edb3a280b9f00&scope.project.id=6f775fd51f8a473e8169d400512f0fe5&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:52:40.860336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:40.860990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:40.861268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:40.861536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:40.873437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:40.875166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:40.890531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:40.891717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:40.892656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:40.892656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:40.892656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:40.892656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 564/1097] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:40.897621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:40.977726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:41.003272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22913ade-51b1-4ac8-a3d2-87eed93fd066 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.038746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.039357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.039641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.039918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.040593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:41.040900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.042265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:41.054822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 534/1098] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:41.060571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:41.116045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:41.159738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ed4-7236-48f0-bffd-be04ab5dc755 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.192647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.193264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.193538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.193805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.201933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.203354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:52:41.214160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:41.215282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:52:41.216266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 565/1099] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Sep 13 07:52:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:41.221174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:41.328467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634612be-c73b-4981-803b-b9ac4cf5ef81 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.361562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.362163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.362437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.362706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.363418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:41.363719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.365150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:41.366858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:41.383002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 535/1100] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Sep 13 07:52:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:41.388642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:41.491178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f949cff-a3d0-466e-8b3f-dc227e9d0939 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.504676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:41.524356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.524954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.525227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.525495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.591463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.592851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:41.688640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 566/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:41.694443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:41.794824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90e00-13a3-46d8-ae8e-86d344831430 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.828741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.829431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.829714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.829991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.839719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.841184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:52:41.855956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:41.857356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:52:41.858489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:52:41.858489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:52:41.858489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:41.858489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 536/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:52:41.862965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:41.878021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:41.960950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35195b51-1c79-425a-8ab8-7b2dae44c11b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:41.994280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:41.994877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:41.995156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:41.995428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:41.996099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:41.996391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:41.997736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:42.009401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 567/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:42.015305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:42.060809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:42.115720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc21df-ecb7-4562-936b-599130bae25e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:42.149734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:42.150356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:42.150640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:42.150907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:42.157783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:42.159210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:52:42.170430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:52:42.171500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:52:42.172606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 537/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:52:42.177536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:42.250769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:42.281278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38069aa-53d9-4637-bf91-670027ab8ae1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:42.315687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:42.316320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:42.316605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:42.316882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:42.317561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:42.317868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:42.319286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d8be-0128-4526-a542-67930e4ee9e5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:42.331083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 568/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:42.336908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:42.432896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9c35-ecbd-480d-b5a0-cabbe912e11e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:42.435086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:42.465982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:42.466583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:42.466861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:42.467127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:42.467843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] RBAC: Adding query filter params (role.id=47b78af1eb9840c2965c5cd176969e3a, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=5f3b6c53dcc844c784c17f6c4af76bfb) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:42.468268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:42.469906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06012fc1-fd13-4b70-b9a9-24d361d4af4b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:42.476066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 538/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:42 2022] GET /identity/v3/role_assignments?user.id=5f3b6c53dcc844c784c17f6c4af76bfb&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=47b78af1eb9840c2965c5cd176969e3a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:43.057468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f77cf-0c0f-461c-8e1e-2facb9802cb9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:43.058012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f77cf-0c0f-461c-8e1e-2facb9802cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:43.058116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f77cf-0c0f-461c-8e1e-2facb9802cb9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:43.059388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 569/1107] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:43.065328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:43.065765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:43.065946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:43.084985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:43.086196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:43.157433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 539/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:43.429542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f77cf-0c0f-461c-8e1e-2facb9802cb9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:43.533423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f77cf-0c0f-461c-8e1e-2facb9802cb9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:43.566689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:43.567310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:43.567589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:43.567860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:43.568977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:43.570394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f05bcc-ea81-4dac-9ee8-77f919515a44 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:43.571945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 570/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:43.578217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:43.670013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:43.673639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfa8e-819e-48cc-b15a-d9feccea0ee5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:43.706496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:43.707027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:43.707301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:43.707568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:43.708239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:43.709720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06997c-1dbb-4bfe-aab9-969b6352e400 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:43.790799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 540/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:52:43 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:45.979535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cadc-0c19-4d8c-8c76-1fc18d40beef None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:45.980203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cadc-0c19-4d8c-8c76-1fc18d40beef None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:45.980203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cadc-0c19-4d8c-8c76-1fc18d40beef None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:45.981472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 571/1111] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:45.986860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:45.987266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:45.987404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:46.013445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:46.014634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:46.083052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 541/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:46.362917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cadc-0c19-4d8c-8c76-1fc18d40beef None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:46.365815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:46.461390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cadc-0c19-4d8c-8c76-1fc18d40beef None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:46.495059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:46.495671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:46.495948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:46.496243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] PATH_INFO: `/v3/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:46.497606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] RBAC: Authorizing `identity:get_role(role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:46.498952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:46.501212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 572/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:46 2022] GET /identity/v3/roles/7cd14d5c176345a398d14136efaa152f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:46.507124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:46.589787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:46.605837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209c82-90c1-4340-816f-f4aa27d773b6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:46.640251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:46.640877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:46.641158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:46.641429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] PATH_INFO: `/v3/users/4658b49759bc47bdaea866d0a009a435` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:46.653813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4658b49759bc47bdaea866d0a009a435)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:46.655905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:46.657949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 542/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:46 2022] GET /identity/v3/users/4658b49759bc47bdaea866d0a009a435 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:46.663955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:46.729534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:46.758810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14f964-e836-4ed5-8633-de38e6fe43a4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:46.791030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:46.791615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:46.791892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:46.792188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:46.861017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:46.862353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:46.927577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:46.957002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 573/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:46.962914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:47.061211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b2a8-171b-48a2-8de7-d00b970909e6 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:47.099422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:47.100066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:47.100349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:47.100621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:47.101721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:47.103141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02dbdc-b819-4895-8a64-adeef45d13a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:47.104782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 543/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:46 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:47.111510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:47.212549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd968d-4299-4c9a-aa4d-69720a2fa021 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:47.244722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:47.245306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:47.245584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:47.245853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:47.246552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=6f775fd51f8a473e8169d400512f0fe5, user.id=4658b49759bc47bdaea866d0a009a435) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:47.246856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:47.248290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917487-cc23-4d16-a142-bd6badff8b59 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:47.254031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 574/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:47 2022] GET /identity/v3/role_assignments?user.id=4658b49759bc47bdaea866d0a009a435&scope.project.id=6f775fd51f8a473e8169d400512f0fe5&role.id=7cd14d5c176345a398d14136efaa152f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:49.422343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57df25-4653-4507-8ef1-8aa8c70c4cd2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:49.422891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57df25-4653-4507-8ef1-8aa8c70c4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:49.422891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57df25-4653-4507-8ef1-8aa8c70c4cd2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:49.424226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 544/1118] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:49.429423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:49.429847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:49.429967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:49.448198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:49.449364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:49.474463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:49.528745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 575/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:49.801918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57df25-4653-4507-8ef1-8aa8c70c4cd2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:49.814989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:49.901168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57df25-4653-4507-8ef1-8aa8c70c4cd2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:49.934538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:49.935152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:49.935428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:49.935697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] PATH_INFO: `/v3/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:49.937223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] RBAC: Authorizing `identity:get_role(role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:49.938614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:49.939922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 545/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:49 2022] GET /identity/v3/roles/7cd14d5c176345a398d14136efaa152f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:49.945742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:50.039696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a49f7d-63c8-4ba7-a870-3af4c440f693 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:50.072345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:50.072896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:50.073171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:50.073440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] PATH_INFO: `/v3/users/4658b49759bc47bdaea866d0a009a435` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:50.074523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] RBAC: Authorizing `identity:get_user(user_id=4658b49759bc47bdaea866d0a009a435)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:50.075935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:50.077525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 576/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:49 2022] GET /identity/v3/users/4658b49759bc47bdaea866d0a009a435 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:50.083117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:50.165147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:50.188132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01975-ffd3-4e27-8f64-fbd159e660cd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:50.221093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:50.221711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:50.221994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:50.222268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:50.223378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:50.224828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e247d51-761e-41ed-b628-74cab9061394 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:50.226454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 546/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:50 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:50.232421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:50.263289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:50.330973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5007445-5673-4c14-bb34-7d1e606b82d2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:50.363536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:50.364273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:50.364547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:50.364816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5/users/4658b49759bc47bdaea866d0a009a435/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:50.366885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] RBAC: Authorizing `identity:create_grant(project_id=6f775fd51f8a473e8169d400512f0fe5, user_id=4658b49759bc47bdaea866d0a009a435, role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:50.368351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b38e-de7e-4516-bdcd-3a70caf3bd9f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:50.413396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 577/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:52:50 2022] PUT /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5/users/4658b49759bc47bdaea866d0a009a435/roles/7cd14d5c176345a398d14136efaa152f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:52:52.552699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d59c-b0f7-4e10-b93e-b200fdedbea0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:52.553204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d59c-b0f7-4e10-b93e-b200fdedbea0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:52.553313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d59c-b0f7-4e10-b93e-b200fdedbea0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:52.554587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 547/1124] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:52.559865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:52.560299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:52.560448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:52.578466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:52.579679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:52.645922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 578/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:52:52.922963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d59c-b0f7-4e10-b93e-b200fdedbea0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:53.022188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d59c-b0f7-4e10-b93e-b200fdedbea0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:53.055055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:53.055670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:53.055945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:53.056246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] PATH_INFO: `/v3/roles/7cd14d5c176345a398d14136efaa152f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:53.057639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] RBAC: Authorizing `identity:get_role(role_id=7cd14d5c176345a398d14136efaa152f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:53.059022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:53.060357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 548/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:52 2022] GET /identity/v3/roles/7cd14d5c176345a398d14136efaa152f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:53.066693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:53.088999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:53.162445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bcb87-0a6f-4f5a-9ec1-f5f173356707 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:53.194788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:53.195347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:53.195629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:53.195907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] PATH_INFO: `/v3/users/4658b49759bc47bdaea866d0a009a435` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:53.197042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] RBAC: Authorizing `identity:get_user(user_id=4658b49759bc47bdaea866d0a009a435)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:53.198460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:53.200050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 579/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:52:53 2022] GET /identity/v3/users/4658b49759bc47bdaea866d0a009a435 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:53.206692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:53.222637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:53.305987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cad35-50e0-4ee2-9fe2-059d5d6b4b05 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:53.339376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:53.340024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:53.340279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:53.340551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:53.405949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:53.407384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:53.421409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:53.501183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 549/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:52:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:53.507334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:53.598902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:53.608001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652171e-5912-4f8b-a4b9-af190dc53e14 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:53.641580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:53.642206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:53.642488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:53.642761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] PATH_INFO: `/v3/projects/6f775fd51f8a473e8169d400512f0fe5` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:53.643863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] RBAC: Authorizing `identity:get_project(project_id=6f775fd51f8a473e8169d400512f0fe5)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:53.645310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f615d2-4116-40ab-a844-42b1586d4533 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:53.646932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 580/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:52:53 2022] GET /identity/v3/projects/6f775fd51f8a473e8169d400512f0fe5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:53.653218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:53.749315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc81d4-401d-4cfd-bdcb-2de23e4c5e8a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:53.768006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:53.788185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:53.788786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:53.789063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:53.789335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:53.790045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] RBAC: Adding query filter params (role.id=7cd14d5c176345a398d14136efaa152f, scope.project.id=6f775fd51f8a473e8169d400512f0fe5, user.id=4658b49759bc47bdaea866d0a009a435) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:52:53.790353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:53.791825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8a3e-28ba-4f68-9252-49f721d5946e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:53.798567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 550/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:52:53 2022] GET /identity/v3/role_assignments?user.id=4658b49759bc47bdaea866d0a009a435&scope.project.id=6f775fd51f8a473e8169d400512f0fe5&role.id=7cd14d5c176345a398d14136efaa152f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:55.966091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd607-7341-49d8-949d-0b747756b29f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:55.966664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd607-7341-49d8-949d-0b747756b29f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:55.966782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd607-7341-49d8-949d-0b747756b29f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:55.968226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 581/1131] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:55.973540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:55.973923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:55.974126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:55.992475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:55.996328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:56.059668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 551/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:56.335825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd607-7341-49d8-949d-0b747756b29f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:56.439299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd607-7341-49d8-949d-0b747756b29f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:56.471961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:56.472599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:56.472874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:56.473139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:56.474217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:56.475617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417fafd-eb4b-4e10-bcf3-b8c8b14ac1b1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:56.477185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 582/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:56.483048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:56.579639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a2fc-aae2-4a1f-899b-88341dcd7073 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:56.588543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:56.613031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:56.613623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:56.613903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:56.614175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:56.614832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:56.616324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac503-13ac-450e-8b04-313f9457b9ae None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:56.700068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 552/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:52:56 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:52:58.930590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c158bc-95a2-45fc-8591-5d7928a01d22 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:58.931129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c158bc-95a2-45fc-8591-5d7928a01d22 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:58.931129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c158bc-95a2-45fc-8591-5d7928a01d22 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:58.935068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 583/1135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:52:58.938276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:58.938671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:58.938831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:58.957574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:52:58.958763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:52:59.023624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 553/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:52:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:52:59.300159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c158bc-95a2-45fc-8591-5d7928a01d22 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:59.327433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:59.402278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c158bc-95a2-45fc-8591-5d7928a01d22 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:59.434512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:59.435125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:59.435399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:59.435669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:59.437325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:59.438725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560ee4-ba3f-4e71-9dc7-60298fa67cef None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:59.440291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 584/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:52:59.446029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:52:59.532812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:59.542230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fcf54-d787-4364-b399-d1da3bd52c3a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:52:59.578283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:52:59.578888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:52:59.579168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:52:59.579440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:52:59.580131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:52:59.581557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dcc57-3ad2-4ed7-adba-ce087406ecf1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:52:59.687648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 554/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:52:59 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:53:01.862529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39dd2-755a-4462-bc88-9066000c3246 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:01.863091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39dd2-755a-4462-bc88-9066000c3246 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:01.863091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39dd2-755a-4462-bc88-9066000c3246 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:01.864561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 585/1139] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:01.869852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:01.870243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:01.870398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:01.888115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:01.889402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:01.954711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 555/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:02.221561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b39dd2-755a-4462-bc88-9066000c3246 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:02.311590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:02.318469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b39dd2-755a-4462-bc88-9066000c3246 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:02.351428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:02.352067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:02.352345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:02.352613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:02.362401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:02.367106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:02.368198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:02.369368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 586/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:02.375101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:02.448255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:02.484282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be815ba9-ddd9-429d-b146-35cc6e0ee642 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:02.518759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:02.519358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:02.519632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:02.519901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:02.520582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:02.520889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:02.522242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:02.530306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 556/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:02.536008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:02.631013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5522-49ba-4ef3-9cdb-b154288586fd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:02.663699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:02.664326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:02.664602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:02.664868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] PATH_INFO: `/v3/users/1eb48762ab124a1db2c7d3d23a482f28` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:02.678692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] RBAC: Authorizing `identity:get_user(user_id=1eb48762ab124a1db2c7d3d23a482f28)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:02.681008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:02.682587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 587/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:02 2022] GET /identity/v3/users/1eb48762ab124a1db2c7d3d23a482f28 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:02.688365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:02.787421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75299-3d98-4e10-bf1f-9c6d8bc10417 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:02.826435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:02.827579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:02.827860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:02.828151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:02.839221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:02.900147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:02.901591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:02.996159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 557/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:53:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:53:03.002383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:03.017136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:03.099774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584437b7-a07b-4765-bd97-5cdcf5cb2f6a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:03.142777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:03.143405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:03.143682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:03.143952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] PATH_INFO: `/v3/projects/d7daf61a77c149639fc038f6f80e0529` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:03.145081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=d7daf61a77c149639fc038f6f80e0529)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:03.146492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5961fe9-3fb9-428c-bd5e-ce0ac2e2e7b3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:03.148143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 588/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:03 2022] GET /identity/v3/projects/d7daf61a77c149639fc038f6f80e0529 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:03.154325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:03.195158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:03.254242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034a3ca-afb1-4632-9c7d-3d3a0524fb8e None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:03.288056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:03.288658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:03.288933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:03.289201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:03.289909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d7daf61a77c149639fc038f6f80e0529, user.id=1eb48762ab124a1db2c7d3d23a482f28) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:03.290214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:03.291629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd2a-1bba-47bc-bf36-c5b224f649ab None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:03.297511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 558/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:53:03 2022] GET /identity/v3/role_assignments?user.id=1eb48762ab124a1db2c7d3d23a482f28&scope.project.id=d7daf61a77c149639fc038f6f80e0529&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:05.457866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcb5f-02e1-45e1-a07a-a05e25e97ea4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:05.458391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcb5f-02e1-45e1-a07a-a05e25e97ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:05.458391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fcb5f-02e1-45e1-a07a-a05e25e97ea4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:05.459737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 589/1147] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:05.464799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:05.465215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:05.465336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:05.485106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:05.486270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:05.549619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 559/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:05.827456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fcb5f-02e1-45e1-a07a-a05e25e97ea4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:05.906471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:05.926404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fcb5f-02e1-45e1-a07a-a05e25e97ea4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:05.959336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:05.959954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:05.960265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:05.960538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:05.970789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:05.975592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:05.976543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:05.977392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 590/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:05.983378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:06.013681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:06.081237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41e00b-96ef-433c-8514-2a90a00b02cf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:06.114829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:06.115421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:06.115702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:06.115997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:06.116654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:06.116962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:06.118320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:06.126354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 560/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:06.132140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:06.229779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1b11-d88c-4699-8a7a-fa80672fdae9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:06.261657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:06.262285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:06.262566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:06.262839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] PATH_INFO: `/v3/users/1eb48762ab124a1db2c7d3d23a482f28` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:06.263947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] RBAC: Authorizing `identity:get_user(user_id=1eb48762ab124a1db2c7d3d23a482f28)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:06.265399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:06.266963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 591/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:06 2022] GET /identity/v3/users/1eb48762ab124a1db2c7d3d23a482f28 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:06.272687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:06.365426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:06.371717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992957f8-2a93-44ef-9fb4-4317fe5c6be3 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:06.404287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:06.405407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:06.405687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:06.405955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] PATH_INFO: `/v3/projects/d7daf61a77c149639fc038f6f80e0529` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:06.407056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] RBAC: Authorizing `identity:get_project(project_id=d7daf61a77c149639fc038f6f80e0529)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:06.408504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03463b-1772-46db-b870-976eba85fb41 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:06.410149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 561/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:06 2022] GET /identity/v3/projects/d7daf61a77c149639fc038f6f80e0529 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:06.416500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:06.427995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:06.513151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a7bf-0432-46da-adf7-1786965a7652 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:06.545916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:06.546554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:06.546829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:06.547095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] PATH_INFO: `/v3/projects/d7daf61a77c149639fc038f6f80e0529/users/1eb48762ab124a1db2c7d3d23a482f28/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:06.548961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7daf61a77c149639fc038f6f80e0529, user_id=1eb48762ab124a1db2c7d3d23a482f28, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:06.550369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe02a-3f7a-4b17-b9fe-d740db13b2f7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:06.630029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 592/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:53:06 2022] PUT /identity/v3/projects/d7daf61a77c149639fc038f6f80e0529/users/1eb48762ab124a1db2c7d3d23a482f28/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:53:08.756508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c531a9-c199-4569-be39-4398c177678b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:08.757041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c531a9-c199-4569-be39-4398c177678b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:08.757041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c531a9-c199-4569-be39-4398c177678b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:08.758384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 562/1154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:08.763531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:08.764456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:08.764646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:08.782969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:08.784174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:08.842660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:08.848746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 593/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:09.121241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c531a9-c199-4569-be39-4398c177678b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:09.220624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c531a9-c199-4569-be39-4398c177678b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:09.253439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:09.254057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:09.254339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:09.254614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:09.265276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:09.270096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:09.271175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:53:09.272047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 563/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:09.277366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:09.371471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb1f69-2a2d-474e-a99e-0d2693768953 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:09.404037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:09.405423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:09.405699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:09.406034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:09.407052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:09.407354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:09.408738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:09.417284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 594/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:09.424320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:09.449184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:09.525670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d97b-8d11-4319-bfe3-87913bbb8e6a None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:09.558175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:09.558794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:09.559077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:09.559350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] PATH_INFO: `/v3/users/1eb48762ab124a1db2c7d3d23a482f28` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:09.560484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] RBAC: Authorizing `identity:get_user(user_id=1eb48762ab124a1db2c7d3d23a482f28)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:09.562517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:09.564107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 564/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:09 2022] GET /identity/v3/users/1eb48762ab124a1db2c7d3d23a482f28 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:09.569846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:09.631712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:09.671072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b086c89-ccc4-4dc8-affc-c4be59892aa8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:09.704305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:09.717646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:09.717646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:09.717646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:09.771192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:09.772656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:09.827608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:09.867988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 595/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:53:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:53:09.874437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:09.963398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:09.972445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec6b4f-e980-485c-b9e6-8ed85f69efc5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:10.004724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:10.005336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:10.005612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:10.005881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] PATH_INFO: `/v3/projects/d7daf61a77c149639fc038f6f80e0529` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:10.006971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] RBAC: Authorizing `identity:get_project(project_id=d7daf61a77c149639fc038f6f80e0529)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:10.008415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685bcbb-f300-4a25-98ae-34040311bdfa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:10.010012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 565/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:09 2022] GET /identity/v3/projects/d7daf61a77c149639fc038f6f80e0529 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:10.016859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:10.113468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c427-32eb-4194-9d0c-ced0581ced74 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:10.146784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:10.147372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:10.147655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:10.147927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:10.148660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d7daf61a77c149639fc038f6f80e0529, user.id=1eb48762ab124a1db2c7d3d23a482f28) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:10.148968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:10.150375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a56f-f6a7-4418-8366-70c0d3bb769a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:10.156039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 596/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:53:10 2022] GET /identity/v3/role_assignments?user.id=1eb48762ab124a1db2c7d3d23a482f28&scope.project.id=d7daf61a77c149639fc038f6f80e0529&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:12.321363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678271-3021-4139-ba59-45be08d75699 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:12.321853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678271-3021-4139-ba59-45be08d75699 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:12.321963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678271-3021-4139-ba59-45be08d75699 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:12.323224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 566/1162] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:12.329158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:12.329543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:12.329705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:12.347539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:12.348739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:12.365145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:12.412774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 597/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:12.680201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678271-3021-4139-ba59-45be08d75699 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:12.778196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678271-3021-4139-ba59-45be08d75699 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:12.811965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:12.812597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:12.812876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:12.813148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:12.839110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:12.878435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:12.879880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:12.976275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 567/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:53:12.982077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:13.076184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4a34-c52f-42a3-918f-c70d14d74600 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:13.109968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:13.110602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:13.110880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:13.111151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:13.117722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:13.119146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ce2e1244-2bbe-4281-9ae9-16ee9e33d04a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:13.130269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:13.131527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:13.132491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 598/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:53:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:13.137368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:13.193385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:13.234067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8616a-68f7-458d-b904-27e79eff4255 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:13.266189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:13.266790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:13.267069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:13.267335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:13.267965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:13.268289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:13.269634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271729c9-ad95-4201-a3cd-e375d370aae7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:13.276940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 568/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Sep 13 07:53:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:15.450671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d757-db30-4bf4-8be0-5201c0c02efb None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:15.451243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d757-db30-4bf4-8be0-5201c0c02efb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:15.451243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d757-db30-4bf4-8be0-5201c0c02efb None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:15.452916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 599/1167] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:15.458309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770561b5-caa7-4058-b7e3-8c679a12a895 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:15.458681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770561b5-caa7-4058-b7e3-8c679a12a895 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:15.458865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770561b5-caa7-4058-b7e3-8c679a12a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:15.476862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-770561b5-caa7-4058-b7e3-8c679a12a895 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:15.478046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-770561b5-caa7-4058-b7e3-8c679a12a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:15.553219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 569/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:15.825120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d757-db30-4bf4-8be0-5201c0c02efb None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:15.840265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:15.923719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d757-db30-4bf4-8be0-5201c0c02efb None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:15.956271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:15.956868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:15.957147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:15.957421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:15.958084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:15.959426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c6dc7-8428-4ac9-883a-043dc6d83aa3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:16.031616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 600/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Sep 13 07:53:15 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:53:18.236790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0d4c-c1e9-44c4-9c24-ca38e9cc8c1a None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:18.237346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0d4c-c1e9-44c4-9c24-ca38e9cc8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:18.237346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0d4c-c1e9-44c4-9c24-ca38e9cc8c1a None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:18.238685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 570/1170] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:18.244002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:18.244400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:18.244548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:18.262793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:18.264250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:18.328955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 601/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:18.612913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0d4c-c1e9-44c4-9c24-ca38e9cc8c1a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:18.665672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:18.712329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0d4c-c1e9-44c4-9c24-ca38e9cc8c1a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:18.746004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:18.746633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:18.746928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:18.747201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] PATH_INFO: `/v3/domains/161543b22bf24063ad841258f40164d0` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:18.757613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] RBAC: Authorizing `identity:get_domain(domain_id=161543b22bf24063ad841258f40164d0)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:18.759050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dd743-cdfd-4d70-a382-80465f74790f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:18.760653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 571/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Sep 13 07:53:18 2022] GET /identity/v3/domains/161543b22bf24063ad841258f40164d0 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:18.767034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:18.770093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:18.862640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6c3a1-8e2f-4cc0-b002-47346c8bdc6d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:18.896151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:18.896684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:18.896963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:18.897234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:18.897873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:18.899283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302d4e7-5997-4457-9830-75a18861802b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:19.003117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 602/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:53:18 2022] POST /identity/v3/projects => generated 361 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:53:21.195254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237807bb-192a-4771-b4ae-e8e0655bbc89 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:21.195811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237807bb-192a-4771-b4ae-e8e0655bbc89 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:21.195811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237807bb-192a-4771-b4ae-e8e0655bbc89 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:21.197187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 572/1174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:21.202603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:21.203044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:21.203137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:21.221246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:21.222403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:21.270527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:21.286197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 603/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:21.565942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237807bb-192a-4771-b4ae-e8e0655bbc89 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:21.668127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237807bb-192a-4771-b4ae-e8e0655bbc89 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:21.680888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:21.701932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:21.702553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:21.702830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:21.703645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] PATH_INFO: `/v3/domains/161543b22bf24063ad841258f40164d0` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:21.704424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=161543b22bf24063ad841258f40164d0)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:21.705882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd865-53b1-4734-90d4-2eb77e62d2fa None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:21.707473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 573/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Sep 13 07:53:21 2022] GET /identity/v3/domains/161543b22bf24063ad841258f40164d0 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:21.713248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:21.808943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9084-d00c-4d58-82da-69c05e38c961 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:21.842234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:21.842858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:21.843139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:21.843411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:21.844082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:21.845509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a414329-a1bb-4803-9f0f-40ebb20145fd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:21.921252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 604/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:53:21 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:53:24.099073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59459-3584-430b-8e4a-43aae62a3b72 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:24.099606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59459-3584-430b-8e4a-43aae62a3b72 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:24.099606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d59459-3584-430b-8e4a-43aae62a3b72 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:24.101019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 574/1178] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:24.106094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:24.106476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:24.106635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:24.125067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:24.126224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:24.159968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:24.189857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 605/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:24.460665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d59459-3584-430b-8e4a-43aae62a3b72 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:24.558059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d59459-3584-430b-8e4a-43aae62a3b72 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:24.590728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:24.591337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:24.591612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:24.591881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:24.602666 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:24.607357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:24.608520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:53:24.609378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 575/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:24.614535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:24.714065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895a75f-26b0-4abb-b598-d429ef4925e7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:24.746734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:24.747329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:24.747608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:24.747875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:24.748555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:24.748856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:24.750323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:24.758001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 606/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:24.764241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:24.806340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:24.862648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc273b06-5a1a-4c6d-976e-78f329cf37af None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:24.895016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:24.895628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:24.895907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:24.896202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] PATH_INFO: `/v3/users/0092993e26ca4dbeaf8f892413b28091` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:24.908759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] RBAC: Authorizing `identity:get_user(user_id=0092993e26ca4dbeaf8f892413b28091)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:24.910187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:24.911757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 576/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:24 2022] GET /identity/v3/users/0092993e26ca4dbeaf8f892413b28091 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:24.917765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:24.951159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:25.013078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e61e-5f55-4b06-a0ab-30d2d8d3f9ed None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:25.044869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:25.045456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:25.045731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:25.046205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:25.109453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:25.110874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:25.142139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:25.204385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 607/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:53:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 07:53:25.210313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:25.304307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:25.308054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dece5-507e-4dd5-b34c-5c7302724929 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:25.340836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:25.341451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:25.341727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:25.341998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] PATH_INFO: `/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:25.343087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] RBAC: Authorizing `identity:get_project(project_id=d10c0ba8ae8843a7a186afac79dbfc88)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:25.344698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352794c8-40d7-4692-81dc-ffba4a1271b9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:25.346311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 577/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:25 2022] GET /identity/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:25.352386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:25.446433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc5df-38ce-4562-be0b-c05109ebeb7e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:25.478202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:25.478783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:25.479058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:25.479325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:25.480045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d10c0ba8ae8843a7a186afac79dbfc88, user.id=0092993e26ca4dbeaf8f892413b28091) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:25.480353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:25.481743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e50f2-f782-45a6-8189-4f88fc6cef53 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:25.483964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:25.487619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 608/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:53:25 2022] GET /identity/v3/role_assignments?user.id=0092993e26ca4dbeaf8f892413b28091&scope.project.id=d10c0ba8ae8843a7a186afac79dbfc88&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:27.598004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195303-61e1-426e-bb21-87b968b3c6ee None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:27.598537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195303-61e1-426e-bb21-87b968b3c6ee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:27.598537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195303-61e1-426e-bb21-87b968b3c6ee None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:27.599878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 578/1186] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:27.605144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:27.605557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:27.605702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:27.624469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:27.625662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:27.697238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 609/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:27.971690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195303-61e1-426e-bb21-87b968b3c6ee None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:28.071193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195303-61e1-426e-bb21-87b968b3c6ee None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:28.104396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:28.105013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:28.105291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:28.105560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:28.116346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:28.121070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:28.122170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:53:28.123453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 579/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:28.128721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:28.225060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8c21-0281-48eb-baaf-8bb49934da64 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:28.250974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:28.258422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:28.260332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:28.260332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:28.260332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:28.260332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:28.260685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:28.261851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:28.276066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 610/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:28.277060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:28.305440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:28.378054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482f15-3d7e-4c9a-8896-7446c450e9d1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:28.411516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:28.412156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:28.412692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:28.412966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] PATH_INFO: `/v3/users/0092993e26ca4dbeaf8f892413b28091` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:28.414069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=0092993e26ca4dbeaf8f892413b28091)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:28.415491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:28.417075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 580/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:28 2022] GET /identity/v3/users/0092993e26ca4dbeaf8f892413b28091 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:53:28.423455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:28.520767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c179d3-b74f-497f-b3e2-b98c2fbac2b3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:28.553538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:28.554154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:28.554433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:28.554706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] PATH_INFO: `/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:28.555796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d10c0ba8ae8843a7a186afac79dbfc88)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:28.557228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b2d5b-9053-4cba-8e67-1ffe6d98a7c4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:28.558816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 611/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:28 2022] GET /identity/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:28.565280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:28.654713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:28.662436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6aadf-4c11-4fbf-a02d-5448f8134ad7 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:28.695996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:28.696658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:28.696936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:28.697206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] PATH_INFO: `/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88/users/0092993e26ca4dbeaf8f892413b28091/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:28.699080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d10c0ba8ae8843a7a186afac79dbfc88, user_id=0092993e26ca4dbeaf8f892413b28091, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:28.700582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5463-7fcb-46cf-bc02-751bd2dc37e1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:28.761011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 581/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:53:28 2022] PUT /identity/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88/users/0092993e26ca4dbeaf8f892413b28091/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:53:30.857623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53eb91-f1a5-4160-ac83-e7da18d7281d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:30.858190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53eb91-f1a5-4160-ac83-e7da18d7281d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:30.859106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53eb91-f1a5-4160-ac83-e7da18d7281d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:30.860518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 612/1193] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:53:30.865693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:30.866129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:30.866236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:30.885234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:53:30.886428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:53:30.951008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 582/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:53:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:53:31.225410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53eb91-f1a5-4160-ac83-e7da18d7281d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:31.284791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:31.327148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53eb91-f1a5-4160-ac83-e7da18d7281d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:31.361072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:31.361686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:31.361967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:31.362241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:31.373108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:53:31.378456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:53:31.379555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:53:31.380615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 613/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:53:31.385756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:31.466451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:31.482083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198caac-3e0b-4d5e-b8f4-cb306d7326c8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:31.515915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:31.516535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:31.516808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:31.517075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:31.517732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:31.518030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:31.519487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:31.527643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 583/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:31.534205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:31.630898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3951d-8f60-4396-846d-a1d315bf4105 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:31.647285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:31.663426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:31.664081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:31.664358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:31.664624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] PATH_INFO: `/v3/users/0092993e26ca4dbeaf8f892413b28091` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:31.665712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] RBAC: Authorizing `identity:get_user(user_id=0092993e26ca4dbeaf8f892413b28091)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:31.667116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:31.668706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 614/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Sep 13 07:53:31 2022] GET /identity/v3/users/0092993e26ca4dbeaf8f892413b28091 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:31.674634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:31.778329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fad1-1b16-48cd-9261-d3971483922b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:31.810237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:31.810834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:31.811108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:31.811894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:31.827616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:31.877439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:31.878871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:31.972286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 584/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:53:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:53:31.978220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:32.073520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0514ec-ddf6-4310-8e80-b9c43190651d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:32.104581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:32.105189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:32.105464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:32.105732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] PATH_INFO: `/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:32.106803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=d10c0ba8ae8843a7a186afac79dbfc88)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:32.108808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc9def-9b9f-47d8-8642-f5684ebe7aa7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:32.110388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 615/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Sep 13 07:53:31 2022] GET /identity/v3/projects/d10c0ba8ae8843a7a186afac79dbfc88 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:32.116372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:53:32.160873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:32.212433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6346-7a28-4da4-885c-41bf9e8c6e27 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:53:32.245037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:53:32.245626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:53:32.245904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:53:32.246173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:53:32.246879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=d10c0ba8ae8843a7a186afac79dbfc88, user.id=0092993e26ca4dbeaf8f892413b28091) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:53:32.247183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:53:32.248625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ace3-9d2d-466e-b139-be89c56563a3 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:53:32.254869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 585/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:53:32 2022] GET /identity/v3/role_assignments?user.id=0092993e26ca4dbeaf8f892413b28091&scope.project.id=d10c0ba8ae8843a7a186afac79dbfc88&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:53:42.100625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=73 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:42.252302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=45 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:45.467721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75fd8-7066-490b-aff0-88e6cfe9a8de None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:45.468329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75fd8-7066-490b-aff0-88e6cfe9a8de None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:45.468329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75fd8-7066-490b-aff0-88e6cfe9a8de None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:45.470222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 616/1201] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:54:45.475412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:45.475849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:45.476006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:45.494231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:54:45.495477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:54:45.566138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 586/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:54:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:54:45.845929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c75fd8-7066-490b-aff0-88e6cfe9a8de None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:45.947575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c75fd8-7066-490b-aff0-88e6cfe9a8de None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:45.980028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:45.980644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:45.980917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:45.981181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:45.992069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:45.993481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:46.007096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:46.008290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:46.009714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:46.009714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:46.009714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:46.009714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 617/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:46.014483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:46.116783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abc45-26b1-4319-8f43-da9e82395a98 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:46.144680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:46.150398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:46.151044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:46.151328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:46.151603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:46.152268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:46.152573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:46.153945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05d5f0-9c48-4342-82e2-8cbdb2bc166a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:46.165897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 587/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:46.171725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:46.224658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:46.277258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6695e18-1aa5-4e45-8a55-96a9ca8405ac None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:46.310846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:46.311443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:46.311720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:46.312014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:46.312767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:46.314201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c37024-8e7d-4d3d-9034-6bed51977718 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:46.399426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 618/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Sep 13 07:54:46 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:54:48.600318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de853-8308-497a-aa8f-8ead4ab01493 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:48.600892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de853-8308-497a-aa8f-8ead4ab01493 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:48.600892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de853-8308-497a-aa8f-8ead4ab01493 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:48.602224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 588/1206] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:54:48.607314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:48.607716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:48.607855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:48.626767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:54:48.627969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:54:48.692281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 619/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:54:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:54:48.962156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de853-8308-497a-aa8f-8ead4ab01493 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.065175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de853-8308-497a-aa8f-8ead4ab01493 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.098476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.099103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.099387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.099663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.110876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:54:49.115641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:49.116781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:49.117711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 589/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:54:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:49.122870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.162774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:49.219012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89965-b1f4-456e-9ae3-c6b965ac366b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.252316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.252917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.253218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.253509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.256560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:49.256560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:49.256560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:49.263657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 620/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:49.270207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.325290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:49.373540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631c1d-4490-4bf6-bc5d-9874a4960830 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.406104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.407345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.407618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.407885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.418358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:49.419772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:49.433431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:49.434557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:49.435789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:49.435789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:49.435789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:49.435789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 590/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:49.440451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.538106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:49.540941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ef0c-60a1-4c7c-9936-8c7a4931798c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.574648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.575355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.575638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.575914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.576576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:49.576880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:49.578244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:49.591446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 621/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:49.597683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.695215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46298-0206-4b2e-8f5c-e45699543afd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.696777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:49.728770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.729395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.729678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.729956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.737510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:49.738952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:54:49.750908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:49.753584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:49.754762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 591/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:49.757940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:49.854035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b9141-d18c-42c8-ba55-25f2a87f4ba5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:49.887405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:49.888038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:49.888324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:49.888599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:49.889313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:49.889680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:49.891177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:49.908125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 622/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:54:49.914321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.013738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cce622-2d44-45f5-8ab7-e13e9641f8a4 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:50.046216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:50.046814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:50.047096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:50.048071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:50.077382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:50.114480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:50.115862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:50.212621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 592/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:54:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:54:50.218467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.239221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:50.317820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9fcb-ff8d-4a49-93a3-09e87bd28cb5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:50.353440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:50.354104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:50.354384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:50.354657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:50.364767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:50.366139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:50.381791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:50.387151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:50.388233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:50.388233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:50.388233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:50.388233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 623/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:50.388631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.448858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:50.486471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf727-3003-4acd-8482-eafe86a2543d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:50.518317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:50.518910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:50.519187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:50.519457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:50.520114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:50.520413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:50.521754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:50.533249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 593/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:50.539038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.612896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:50.643799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40505370-4eb5-4e1c-bf0d-c2a1bf2cf61f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:50.676793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:50.677415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:50.677692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:50.677960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:50.684312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:50.685742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:54:50.696762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:50.697845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:50.698784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 624/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:50.704460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.805237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56d3ec-d255-42fd-9e5f-e88a4de2c29c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:50.827339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:50.839333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:50.839939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:50.840266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:50.840540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:50.841226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:50.841535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:50.842970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdb7bd-0b89-4c83-9642-9c6800b33ece None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:50.855154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 594/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:50.862089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:50.975248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65325-a9bc-4429-a767-b653a460de11 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:51.003786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:51.009141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:51.009737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:51.010010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:51.010277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:51.010978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=924118f361c54787b3eb164a7789137e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:51.011280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:51.012703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b1dba-ff48-41bf-b6d5-1cc6a3aeb26b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:51.017940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 625/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:54:50 2022] GET /identity/v3/role_assignments?user.id=924118f361c54787b3eb164a7789137e&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:53.201602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a781-bfa6-4306-9e33-19008bfae8bd None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:53.202186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a781-bfa6-4306-9e33-19008bfae8bd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:53.202186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a781-bfa6-4306-9e33-19008bfae8bd None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:53.204018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 595/1220] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:54:53.209168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:53.209587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:53.209720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:53.228190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:54:53.229368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:54:53.294631 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 626/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:54:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:54:53.564232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a781-bfa6-4306-9e33-19008bfae8bd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:53.669809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a781-bfa6-4306-9e33-19008bfae8bd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:53.703503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:53.704226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:53.704506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:53.704785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:53.714627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:54:53.719526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:53.720660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:53.721674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 596/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:53.726957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:53.824893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f574-3f96-415c-9855-f3ebab509273 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:53.847930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:53.858040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:53.858641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:53.858920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:53.859192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:53.860862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:53.861163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:53.862521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:53.870514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 627/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:53.877065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:53.923176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:53.994834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b39bf-2373-4c06-ba50-a035fd4d1b83 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.028293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.028911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.029187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.029456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.040570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.043157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:54.056210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:54.057305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:54.058581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:54.058581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:54.058581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:54.058581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 597/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:54.063711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.169217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c8ae-d60c-4bf6-ae43-175cf13680cf None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.202812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.203447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.203732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.204092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.204723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:54.205030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.206379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.217759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 628/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:54.224154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.322621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:54.330555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99bfd8-6786-4ca3-bb17-fae0f0cd021d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.366268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.366889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.367173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.367443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.374721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.376708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:54:54.387657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:54.394075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:54.396720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 598/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:54.397418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.441385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:54.492589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7eac-7124-4769-92a8-e23ef101054e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.526887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.527475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.527747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.528113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.528823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:54.529118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.530515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.547867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 629/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:54.553742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.660680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ddd9-efe6-4c32-84a6-a39df2e4967f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.695949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.696552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.696836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.697113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.707426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.708913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:54.723478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:54.724678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:54.725743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:54.725743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:54.725743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:54.725743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 599/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:54.730365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.825845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aad32-464f-4543-a386-deef9c17db1d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:54.828136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:54.859132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:54.860326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:54.860750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:54.861029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:54.861662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:54.861966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:54.863323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:54.874206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 630/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:54:54.880365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:54.890183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:54.980229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6d4f-bb1f-46a9-93f0-e7f81666536c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:55.013336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:55.013952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:55.014230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:55.014502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:55.021022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:55.022452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:54:55.034012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:55.035140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:55.036265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 600/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:55.041232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:55.138763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dbf5a-1f20-4bc9-8696-a50fe02dbd74 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:55.172801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:55.173410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:55.173694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:55.173966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:55.174646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:55.174949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:55.176565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b5d4-96e8-48df-991a-703d4b2bb114 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:55.188844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 631/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:55.195021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:55.262424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:55.299181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d1b7c-0fbd-4a5e-b0dc-94369ed1ad58 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:55.333533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:55.334246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:55.334525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:55.334812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/924118f361c54787b3eb164a7789137e/roles/692a2eabe8de4d99adb45c92b7faa922` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:55.349984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=924118f361c54787b3eb164a7789137e, role_id=692a2eabe8de4d99adb45c92b7faa922)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:55.351420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd29c-e847-48e6-b20d-a1e5a7a3888f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:55.416920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 601/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:54:55 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/924118f361c54787b3eb164a7789137e/roles/692a2eabe8de4d99adb45c92b7faa922 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:54:57.628002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd67a-f958-4366-81ed-c6d1c0a79016 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:57.628569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd67a-f958-4366-81ed-c6d1c0a79016 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:57.628569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd67a-f958-4366-81ed-c6d1c0a79016 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:57.629889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 632/1233] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:54:57.635203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:57.635642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:57.635736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:57.654624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:54:57.655818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:54:57.723058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 602/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:54:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:54:57.988787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd67a-f958-4366-81ed-c6d1c0a79016 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.013454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:58.086319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd67a-f958-4366-81ed-c6d1c0a79016 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.123090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.123714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.124166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.124454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.134927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:54:58.139818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:58.141036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:58.141996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 633/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Sep 13 07:54:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:58.147495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.195518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:58.247200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc4aa-fe2c-4c85-86d8-1c1f801bb377 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.286250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.286859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.287390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.287667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.288349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:58.288836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:58.291283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:58.302214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 603/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:58.308183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.391252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:58.406317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5792a-a59c-44f4-8e09-97ddc0fe251f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.439293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.439899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.440204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.440475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.450494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:58.454925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:58.465336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:58.466408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:58.467475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:58.467475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:58.467475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:58.467475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 634/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:58.472930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.571790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91710-c11f-49b3-98b5-38d01406c9a5 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.580569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:58.604860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.605456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.605739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.606025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.606660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:58.606960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:58.608382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:58.619594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 604/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:58.626176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.723786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba043d44-74ca-47d4-a680-2433fb2527ab None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.756242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.756860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.757139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.757409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.760192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:58.764986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:58.767089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:54:58.778017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:58.779140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:54:58.780300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 635/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:58.785421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:58.885091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0a27-4c10-487e-b2b7-f012291dbd7b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:58.918651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:58.919249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:58.919527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:58.919797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:58.920552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:58.920854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:58.922807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:58.941241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 605/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:58.947095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.043333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476b347-59f1-4f84-a9ab-b1ae8eb06c78 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:59.077922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:59.079705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:59.079705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:59.079705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:59.139751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:59.146366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:59.147811 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:59.244213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 636/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:54:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:54:59.250374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.277441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:59.350791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9d35-82c2-429f-b3ac-e6beec8f8293 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:59.385838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:59.386454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:59.386730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:59.386999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:59.397634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:59.399074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:54:59.413674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:59.415221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:54:59.416464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:54:59.416464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:54:59.416464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:59.416464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 606/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:59.420645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.510476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:59.517260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c323409-c1d1-4d92-b43b-4f5ee690f253 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:59.550218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:59.550817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:59.551093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:59.551363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:59.552012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:59.552317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:59.553657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:59.565221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 637/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:59.571074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.650066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:54:59.671439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31a62f-876a-4d24-a3e3-9b637c754b94 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:59.705021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:59.705639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:59.705916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:59.706192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:59.712627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:59.714043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:54:59.725084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:54:59.726117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:54:59.727191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 607/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:54:59.732034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.831009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7cf7d-635b-49b8-a577-efccd09cd63c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:54:59.863509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:54:59.864136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:54:59.864420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:54:59.864690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:54:59.865364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:54:59.865666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:54:59.867075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248537d-927a-4af6-aec9-ac1499b6baf1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:54:59.880214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 638/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:54:59.886308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:54:59.986223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52f57-acc0-464f-acad-6b0bb7d7e9de None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:00.020826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:00.021487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:00.021774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:00.022052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:00.022823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] RBAC: Adding query filter params (role.id=692a2eabe8de4d99adb45c92b7faa922, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=924118f361c54787b3eb164a7789137e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:00.023134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:00.024594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5922-21e4-449f-a325-c93dc462f10a None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:00.030578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 608/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:54:59 2022] GET /identity/v3/role_assignments?user.id=924118f361c54787b3eb164a7789137e&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=692a2eabe8de4d99adb45c92b7faa922 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:02.253251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcc4d-03c8-4c7a-988f-a4ffe2fa1aa9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:02.253823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcc4d-03c8-4c7a-988f-a4ffe2fa1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:02.253823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcc4d-03c8-4c7a-988f-a4ffe2fa1aa9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:02.255174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 639/1247] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:02.260449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:02.260866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:02.261105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:02.268249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:02.281259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:02.282781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:02.349732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 609/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:55:02.618258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfcc4d-03c8-4c7a-988f-a4ffe2fa1aa9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:02.636808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:02.717023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfcc4d-03c8-4c7a-988f-a4ffe2fa1aa9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:02.748942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:02.749544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:02.750394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:02.750762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:02.761755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:55:02.766617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:02.770448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:02.771497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 640/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:55:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:02.773722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:02.872686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5066da6-4c67-4476-b73d-a88739fe8daf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:02.902341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:02.907176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:02.907864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:02.908193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:02.908463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:02.909112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:02.909413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:02.910812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:02.918968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 610/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:55:02.926135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.004264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:03.026430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc39c-1364-4b62-b1fe-be3f232562a9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.059223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:03.059783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:03.060091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:03.060361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:03.070996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:03.072364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:03.086357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:03.087525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:03.088618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:03.088618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:03.088618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:03.088618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 641/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:03.093279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.193840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e4b5-7931-4729-bdf6-635f15d8c976 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.227184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:03.227784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:03.228090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:03.228363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:03.228996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:03.229299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:03.230651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:03.242083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 611/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:03.247821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.346779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179727f-61ad-4a7d-a9d9-88169020e415 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.371983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:03.382391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:03.383025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:03.383307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:03.383646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:03.390981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:03.392458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:55:03.403630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:03.404741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:03.405776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 642/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:03.410615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.465727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:03.509644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fc161-f7f1-466d-98c2-457d4b611a54 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.543381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:03.544010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:03.544283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:03.544558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:03.545277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:03.545583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:03.547591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:03.565191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 612/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:55:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:03.571114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.669540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a82c2d-0edd-48c9-9a21-63c58a81c8ef None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.702460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:03.703186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:03.703462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:03.703731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:03.758705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:03.770459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:03.771919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:03.867888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 643/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:55:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:55:03.873868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:03.972805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed35d3-1e7d-44df-8677-b284382e5fd1 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:03.985725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:04.006491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:04.007122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:04.007399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:04.007671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:04.018177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:04.019555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:04.034089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:04.035224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:04.036345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:04.036345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:04.036345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:04.036345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 613/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:04.041285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:04.126949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:04.138085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb12c6-7e54-4b8c-928d-d8488533ae85 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:04.170245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:04.170847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:04.171126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:04.171396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:04.172809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:04.173330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:04.176248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:04.193333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 644/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:04.199026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:04.305403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e642f-41bd-4efc-ad31-02d4175e24dd None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:04.339276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:04.339895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:04.340198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:04.340472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:04.347153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:04.348622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:55:04.362891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:04.364048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:04.365167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 614/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:04.369917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:04.472447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43834f3-d974-41f2-9526-38984b82c41c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:04.505643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:04.507320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:04.507320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:04.507320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:04.507582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:04.507757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:04.509291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084d09-1875-4e99-bed2-a5f9a940f4c2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:04.526212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 645/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:04.533031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:04.559209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:04.640469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232c443-239f-4304-8751-d1986015ec2b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:04.675336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:04.675935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:04.676247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:04.676517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:04.677227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=924118f361c54787b3eb164a7789137e) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:04.677536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:04.679003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44d777-ab3a-46ca-a164-fad3e5ebe62b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:04.684207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 615/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:55:04 2022] GET /identity/v3/role_assignments?user.id=924118f361c54787b3eb164a7789137e&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:06.836432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57688-6057-4b5a-83fc-e182439b773a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:06.837047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57688-6057-4b5a-83fc-e182439b773a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:06.837047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57688-6057-4b5a-83fc-e182439b773a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:06.838311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 646/1261] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:06.843467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:06.844448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:06.844774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:06.862986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:06.864200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:06.930726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 616/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:55:07.199746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57688-6057-4b5a-83fc-e182439b773a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:07.214248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:07.321499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57688-6057-4b5a-83fc-e182439b773a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:07.355900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:07.356577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:07.356854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:07.357123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:07.368023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:55:07.372756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:07.373861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:07.377140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 647/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:07.380780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:07.400888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:07.494693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128618a-00d9-45ba-bd77-3e686dcffa08 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:07.521393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:07.521393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:07.521632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:07.521783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:07.522684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:07.522684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:07.524076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:07.533865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 617/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:07.539961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:07.606683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:07.641582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397f4a-e17b-415d-bd10-0670971eb291 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:07.680848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:07.681484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:07.681760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:07.682030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:07.693165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:07.694597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:07.710761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:07.711694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:07.717790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:07.717790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:07.717790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:07.717790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 648/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:07.718019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:07.803182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:07.823110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeda078-f521-46d2-a787-08647af44716 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:07.856313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:07.856942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:07.857190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:07.857463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:07.858095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:07.858395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:07.862637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:07.875586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 618/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:55:07.881276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:07.983055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927e5a0-b6e7-4783-b59f-0bfe8507af5d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.002529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:08.016308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.017028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.017309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.017582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.024890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.026317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:55:08.038302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:08.039440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:08.040837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 649/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:08.045311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.145012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e720a-6b5f-4b41-8a47-6e3a73ca5be9 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.179336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.179938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.180249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.180528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.181249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:08.181555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.182984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.196941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:08.209029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 619/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:55:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:08.214960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.313433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5fcd-c08b-47ca-88f4-c92cf184a2f6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.347197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.347878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.348191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.348484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.358908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.360429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:08.374094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:08.375943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:08.376951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:08.376951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:08.376951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:08.376951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 650/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:08.381856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.480261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04b76-bc67-4f68-9904-96225ff162f2 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.513646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.514248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.514530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.514805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.515563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:08.515936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.517346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.528375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 620/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:55:08.534633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.565955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:08.631891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75ac6-8c1b-42b6-a110-5f8f1f4204ad None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.664279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.664898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.665179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.665452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.673607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.675085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:55:08.686451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:08.688590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:08.690290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 651/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:08.694207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.752412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:08.792379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a157-3e22-4023-a609-1a47a5d33e77 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.825238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.825760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.826038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.826307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.826981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:08.827283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.828869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ed9fb-b0c6-4804-91d5-540ee509707d None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:08.841082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 621/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:08.847501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:08.936734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:08.946280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e694-35ef-42ae-82b0-b4961e6b4d5c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:08.979097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:08.979797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:08.980106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:08.980376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] PATH_INFO: `/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/924118f361c54787b3eb164a7789137e/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:08.982238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] RBAC: Authorizing `identity:create_grant(project_id=507dc049d82d4cf18a1694f3fc00a31f, user_id=924118f361c54787b3eb164a7789137e, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:08.983748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf07735-42d9-4e29-aaff-6056e2a773de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:09.105471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 652/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Sep 13 07:55:08 2022] PUT /identity/v3/projects/507dc049d82d4cf18a1694f3fc00a31f/users/924118f361c54787b3eb164a7789137e/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:55:11.252578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20c84c-2e07-4bc0-b14e-10a9af9e7a36 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:11.253129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20c84c-2e07-4bc0-b14e-10a9af9e7a36 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:11.253129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20c84c-2e07-4bc0-b14e-10a9af9e7a36 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:11.254476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 622/1274] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:11.263688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:11.263688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:11.263688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:11.281811 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:11.283131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:11.353946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 653/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:55:11.638511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20c84c-2e07-4bc0-b14e-10a9af9e7a36 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:11.737632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20c84c-2e07-4bc0-b14e-10a9af9e7a36 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:11.754591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:11.770898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:11.771510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:11.771772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:11.772069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:11.782516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 07:55:11.787495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:11.788662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:11.789726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 623/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Sep 13 07:55:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 07:55:11.794662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:11.874440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:11.893835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96c2f-d812-42a2-83db-e73658dabacc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:11.927358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:11.927954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:11.928358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:11.928672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:11.929315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:11.929614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:11.930988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:11.941773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 654/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Sep 13 07:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:11.945622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.043986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a2eae-ca12-47ad-93a2-56be5e95945d None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:12.077435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:12.078752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:12.079028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:12.079302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:12.089160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:12.090595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:12.105052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:12.106162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:12.107396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:12.107396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:12.107396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:12.107396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 624/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:12.112490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.212111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ac8ab-a7ed-45c3-bb42-f92063067a1b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:12.245216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:12.245812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:12.246091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:12.246363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:12.246989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:12.247296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:12.248674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:12.260710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 655/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:12.267094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.299303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:12.373254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5788-d6c7-4ae0-ab91-fa5e17452f7f None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:12.407098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:12.407714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:12.408013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:12.408282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:12.415741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:12.417205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 07:55:12.428360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:12.429508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:12.430767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 625/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:12.435562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.439347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:12.532251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7f58b-d7df-4602-aed6-b5ca8735d44d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:12.566105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:12.566699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:12.567023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:12.567286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:12.568002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:12.568314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:12.569718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:12.587107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 656/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Sep 13 07:55:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:12.594369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.684415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:12.694569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa198-f166-45c8-ab0d-a857aea0e302 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:12.727127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:12.727720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:12.728041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:12.728320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:12.794830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:12.796318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:12.881473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:12.891407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 626/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Sep 13 07:55:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 07:55:12.897222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:12.958865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:12.996616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dc5f2-23f3-4e07-94fc-8c80e22db898 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:13.029461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:13.030105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:13.030423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:13.030736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:13.041727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:13.043148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 07:55:13.058886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:13.060066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 07:55:13.061437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 07:55:13.061437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 07:55:13.061437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:13.061437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 657/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 07:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:13.065865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:13.164423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686f5f-de3e-4fc5-8767-23bc724a9b0c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:13.198989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:13.199591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:13.199911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:13.200215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:13.200851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:13.201154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:13.202554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:13.214133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 627/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Sep 13 07:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:13.220789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:13.317318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086759d-bfa8-4659-937f-843a0ff2265e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:13.330649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:13.350108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:13.350722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:13.350998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:13.351263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:13.357549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:13.359065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 07:55:13.370164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:13.371200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: ERROR keystone.server.flask.application Sep 13 07:55:13.377459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 658/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Sep 13 07:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:13.378092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:13.428297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:13.478651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704a122-fcb0-4575-a7a8-84ec2033fdac None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:13.512014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:13.512645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:13.512924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:13.513195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:13.513871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:13.514174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:13.515722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f82e-1342-4188-b41b-e43af425aaed None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:13.528174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 628/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Sep 13 07:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:13.535190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:13.631463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8bbd0-bf57-4270-b67e-b4c5d4d442f3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:13.664133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:13.664721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:13.664994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:13.665261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:13.665959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] RBAC: Adding query filter params (role.id=a902366353714eaeb9753ac3ce606c58, scope.project.id=507dc049d82d4cf18a1694f3fc00a31f, user.id=924118f361c54787b3eb164a7789137e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:13.666258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:13.667653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a6d2e-0239-4c60-bce5-9a90d2174f69 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:13.673254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 659/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Sep 13 07:55:13 2022] GET /identity/v3/role_assignments?user.id=924118f361c54787b3eb164a7789137e&scope.project.id=507dc049d82d4cf18a1694f3fc00a31f&role.id=a902366353714eaeb9753ac3ce606c58 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:15.889432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a39d-fa3b-4e93-b893-f10df8825e0b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:15.890614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a39d-fa3b-4e93-b893-f10df8825e0b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:15.890614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a39d-fa3b-4e93-b893-f10df8825e0b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:15.891377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 629/1288] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:15.896700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:15.897138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:15.897229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:15.916304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:15.920897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:15.947275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:15.983390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 660/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:55:16.272831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92a39d-fa3b-4e93-b893-f10df8825e0b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:16.379452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92a39d-fa3b-4e93-b893-f10df8825e0b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:16.389948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:16.414449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:16.415122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:16.415402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:16.415676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:16.416282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:16.417638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:16.427646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:16.433119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:16.434300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 630/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:55:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:16.435297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:16.532612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c183d-04d5-4aa3-a3d0-6d429778ab97 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:16.565991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:16.566596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:16.566872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:16.567142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:16.567766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:16.568087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:16.569476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab7575-ec20-4f62-b672-85f693a584c4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:16.574212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 661/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 07:55:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:16.580217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:16.679843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cda53-0302-410e-a0c2-27f58a1eb199 None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:16.712080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:16.712683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:16.712966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:16.713240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] PATH_INFO: `/v3/services` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:16.713865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:16.714169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:16.715525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c2c9-2785-4893-aa84-2dae1bdf4543 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:16.720484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 631/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 07:55:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:18.891552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12bd8b-1acb-4088-98ba-c7813047fae0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:18.892148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12bd8b-1acb-4088-98ba-c7813047fae0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:18.892148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12bd8b-1acb-4088-98ba-c7813047fae0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:18.893475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 662/1293] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:18.898825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770782-478c-4798-8f40-ccf3381c622d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:18.899265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770782-478c-4798-8f40-ccf3381c622d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:18.899394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770782-478c-4798-8f40-ccf3381c622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:18.918114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8e770782-478c-4798-8f40-ccf3381c622d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:18.919283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8e770782-478c-4798-8f40-ccf3381c622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:18.950243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:18.987075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 632/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:55:19.261216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12bd8b-1acb-4088-98ba-c7813047fae0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:19.292699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:19.362435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12bd8b-1acb-4088-98ba-c7813047fae0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:19.395516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:19.396130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:19.396405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:19.396674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:19.397368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:19.398715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b201b-854a-4700-8e11-2d6bda08ff1f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:19.450444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 663/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Sep 13 07:55:19 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:55:21.634351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0f8-3f3a-4852-85d9-f33859c0940d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:21.634900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0f8-3f3a-4852-85d9-f33859c0940d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:21.634900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0f8-3f3a-4852-85d9-f33859c0940d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:21.636293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 633/1296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:21.641445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:21.641884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:21.641978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:21.660591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:21.661798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:21.732596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 664/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 07:55:22.014010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0f8-3f3a-4852-85d9-f33859c0940d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:22.115414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0f8-3f3a-4852-85d9-f33859c0940d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:22.148917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:22.149532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:22.149809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:22.150075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:22.150643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:22.152027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:22.161453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:22.162876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:22.163731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 634/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:55:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:22.168976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:22.188817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:22.269831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69a20b-584a-4ef2-8ca6-b27b6458b8f6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:22.305885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c6966-e704-4098-8443-068e43474865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:22.306508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6966-e704-4098-8443-068e43474865 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:22.306788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6966-e704-4098-8443-068e43474865 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:22.307085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6966-e704-4098-8443-068e43474865 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:22.307704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c6966-e704-4098-8443-068e43474865 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:22.308030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c6966-e704-4098-8443-068e43474865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:22.309391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c6966-e704-4098-8443-068e43474865 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:22.315679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 665/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 07:55:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:22.321890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:22.353093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:22.424922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd2f2-73d6-4872-acdc-2ca9cc27fd4b None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:22.458174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:22.458768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:22.459054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:22.459331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:22.460047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] RBAC: Adding query filter params (interface=public, service_id=49a3a1fd9927474caefc1a99a5044a24, region_id=RegionOne) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:22.460360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:22.461856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254a6e2-9f40-4d92-9728-43110a2e0821 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:22.466751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 635/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Sep 13 07:55:22 2022] GET /identity/v3/endpoints?service_id=49a3a1fd9927474caefc1a99a5044a24&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:22.473285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c6966-e704-4098-8443-068e43474865 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:22.552621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:22.569966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c6966-e704-4098-8443-068e43474865 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:22.603579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:22.604214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:22.604495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:22.604778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:22.605363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:22.606716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d0bdc-a3b2-4818-90e9-dc9e5b66f086 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:22.614282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 666/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Sep 13 07:55:22 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:55:24.790562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db7f1-b3b8-41f2-ad51-82fe7544e878 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:24.791120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db7f1-b3b8-41f2-ad51-82fe7544e878 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:24.791120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db7f1-b3b8-41f2-ad51-82fe7544e878 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:24.792488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 636/1302] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 07:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:55:24.797716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:24.798116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:24.798257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:24.817021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:55:24.818193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:55:24.887299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 667/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 07:55:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 07:55:25.164879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db7f1-b3b8-41f2-ad51-82fe7544e878 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:25.268488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:25.275183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db7f1-b3b8-41f2-ad51-82fe7544e878 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:25.309662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:25.310287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:25.314769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:25.314769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:25.314769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:25.314769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 07:55:25.322091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 07:55:25.323268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application with Lock( Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self._enter() Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application return self.creator() Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application created_value = creator( Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: ERROR keystone.server.flask.application Sep 13 07:55:25.324612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 637/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Sep 13 07:55:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 07:55:25.329351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:25.403680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:25.426488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d645e-e8b4-4382-a20f-f1d8004def59 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:25.460225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:25.460830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:25.461113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:25.461389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:25.462003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:55:25.462307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:25.463671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b37ec-85e2-42e6-bd7c-1fc4c88d6184 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:25.469271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 668/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Sep 13 07:55:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:55:25.475098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:55:25.581891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ae493-4938-4627-bc9e-4e5c96f5305c None admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:55:25.613971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:55:25.614566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:55:25.614839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:55:25.615109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:55:25.615758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:55:25.617145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dc271-44c7-4949-8770-736d8766bfe2 None admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:55:25.678744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 638/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 07:55:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:55:35.465785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=30 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:55:35.674189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:14.858133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcccf0-8539-448e-a0bb-73addf18b65f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:14.859055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcccf0-8539-448e-a0bb-73addf18b65f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:14.859658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcccf0-8539-448e-a0bb-73addf18b65f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:14.868216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae043-cebb-482a-9c92-456ca1f62f61 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:14.869124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae043-cebb-482a-9c92-456ca1f62f61 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:14.869987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae043-cebb-482a-9c92-456ca1f62f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:14.872184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 669/1307] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:15.021667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-be7ae043-cebb-482a-9c92-456ca1f62f61 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:15.025634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be7ae043-cebb-482a-9c92-456ca1f62f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:15.220018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 639/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:15.525635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:15.525984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:15.526191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:15.527766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 670/1309] 10.222.0.43 () {54 vars in 965 bytes} [Tue Sep 13 08:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:15.534291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329955a-034f-4a26-b98f-9e6d26b27361 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:15.534912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329955a-034f-4a26-b98f-9e6d26b27361 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:15.535412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329955a-034f-4a26-b98f-9e6d26b27361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:15.625306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1329955a-034f-4a26-b98f-9e6d26b27361 None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:15.626681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1329955a-034f-4a26-b98f-9e6d26b27361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:15.650235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:15.715809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 640/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Sep 13 08:01:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:01:15.724736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:15.726768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:15.854864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6567d08-85e7-45f7-952f-924d5d17223a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:15.945826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:15.946572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:15.946971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:15.947315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:15.949216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:16.016675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:16.084307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:16.086397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd1d65-682b-4b84-896d-1e8bf2a72e1c service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:16.109947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 671/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:18.708016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:18.708537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:18.708537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:18.709855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 641/1312] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:18.715928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e2-b22b-4a5c-9d3a-79317a18c2e2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:18.716355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e2-b22b-4a5c-9d3a-79317a18c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:18.716518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba491e2-b22b-4a5c-9d3a-79317a18c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:18.797160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8ba491e2-b22b-4a5c-9d3a-79317a18c2e2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:18.798353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8ba491e2-b22b-4a5c-9d3a-79317a18c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:18.893415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 672/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:19.174109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:19.175649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:19.280624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb067-c0b9-49af-b928-a2b63e2495b8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:19.353870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:19.356239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:19.356850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:19.357128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:19.357401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:19.359003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:19.474236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:19.478540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624176f9-8caa-4a1d-b535-2ab51deb094d service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:19.496316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 642/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:22.230593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:22.231242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:22.231242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:22.232535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 673/1315] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:22.237651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5152e-2b6a-444f-8a8f-92855120d809 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:22.238112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5152e-2b6a-444f-8a8f-92855120d809 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:22.238217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5152e-2b6a-444f-8a8f-92855120d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:22.304217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1ee5152e-2b6a-444f-8a8f-92855120d809 None None] MFA Rules not processed for user `584742ad64ff4f9cb9eb105d29a34654`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:22.305486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1ee5152e-2b6a-444f-8a8f-92855120d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:22.355947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:22.399022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 643/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:22.685628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:22.687162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:22.697369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:22.790621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d518c01-1711-4f6d-9eb9-4882ab47c2e9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:22.864184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:22.864812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:22.865064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:22.865332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:22.866920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:22.927652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:22.972795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:22.974224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64f52-ab67-4b9d-b857-d9b7a6c6050d service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:22.992746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 674/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:25.941138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027123a8-a0bc-4a82-8581-864ac6f16b73 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:25.941712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027123a8-a0bc-4a82-8581-864ac6f16b73 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:25.941815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027123a8-a0bc-4a82-8581-864ac6f16b73 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:25.943122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 644/1318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:25.948945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4799-4432-42d9-8db4-5e918c2f4efb None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:25.949351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4799-4432-42d9-8db4-5e918c2f4efb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:25.949473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec4799-4432-42d9-8db4-5e918c2f4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:26.014630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3dec4799-4432-42d9-8db4-5e918c2f4efb None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:26.015826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3dec4799-4432-42d9-8db4-5e918c2f4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:26.117173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 675/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:01:26.430119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:26.430431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:26.430714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:26.432128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 645/1320] 10.222.0.43 () {54 vars in 965 bytes} [Tue Sep 13 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:26.437869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc749-cef7-4837-bdbf-e9e50026ac96 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:26.438160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc749-cef7-4837-bdbf-e9e50026ac96 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:26.438440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc749-cef7-4837-bdbf-e9e50026ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:26.463018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:26.515902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-261dc749-cef7-4837-bdbf-e9e50026ac96 None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:26.517133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-261dc749-cef7-4837-bdbf-e9e50026ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:26.593125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 676/1321] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Sep 13 08:01:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:26.602889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:26.604441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:26.707894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0368f-0958-4b8d-87ca-254160c9be1b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:26.781521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:26.782124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:26.782402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:26.782671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:26.784285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:26.791584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:26.892745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:26.894438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dedc0d-73ea-457f-a219-7162339b4f97 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:26.912704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 646/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:30.525714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:30.526228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:30.526228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:30.527540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 677/1323] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:30.533076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5148-abdf-4eea-a7c9-19b5aec7fb6e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:30.533502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5148-abdf-4eea-a7c9-19b5aec7fb6e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:30.533704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5148-abdf-4eea-a7c9-19b5aec7fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:30.602030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-812c5148-abdf-4eea-a7c9-19b5aec7fb6e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:30.603258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-812c5148-abdf-4eea-a7c9-19b5aec7fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:30.668254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:30.709856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 647/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:30.996656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:30.998751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:31.103442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff615c-0e34-4073-9c9f-09bbe65694d7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:31.115579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:31.178731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:31.179369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:31.179652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:31.179919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:31.181536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:31.292369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:31.293844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa13fa-91b8-4702-abf5-939c1d48db4c service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:31.313082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 678/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:33.573627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:33.574172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:33.574283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:33.575677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 648/1326] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:33.581006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80821-c98b-46f8-ae3a-407bf3a08441 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:33.581487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80821-c98b-46f8-ae3a-407bf3a08441 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:33.581582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80821-c98b-46f8-ae3a-407bf3a08441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:33.630131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:33.648305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fdb80821-c98b-46f8-ae3a-407bf3a08441 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:33.651745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fdb80821-c98b-46f8-ae3a-407bf3a08441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:33.761088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 679/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:34.041499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:34.043081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:34.148200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9db55-5395-4bc1-b1a2-8a13142f92b6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:34.224439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:34.225073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:34.225346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:34.225610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:34.227794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:34.244660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:34.338944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:34.340344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7173e-52e1-48f5-9198-d9e51bbb52c4 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:34.358709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 649/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:36.643961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:36.644508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:36.644508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:36.645815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 680/1329] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:36.651808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451c43-74bd-4047-a631-3a29ca995506 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:36.652757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451c43-74bd-4047-a631-3a29ca995506 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:36.653280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451c43-74bd-4047-a631-3a29ca995506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:36.727122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bb451c43-74bd-4047-a631-3a29ca995506 None None] MFA Rules not processed for user `584742ad64ff4f9cb9eb105d29a34654`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:36.728686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bb451c43-74bd-4047-a631-3a29ca995506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:36.798189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:36.832770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 650/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:37.118236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:37.119772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:37.224692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5552d60-6447-48a1-b8d6-9a4566fb3dae None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:37.245652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:37.299426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:37.300063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:37.300347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:37.300617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:37.302201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:37.413850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:37.415204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861118f8-e7f1-4e70-b471-134cc0b28622 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:37.433917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 681/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:40.041834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:40.042398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:40.042398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:40.043764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 651/1332] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:40.049196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c2062-2f65-462c-aab9-b8fef4656160 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:40.049575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c2062-2f65-462c-aab9-b8fef4656160 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:40.049754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c2062-2f65-462c-aab9-b8fef4656160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:40.111874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:40.114518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5c5c2062-2f65-462c-aab9-b8fef4656160 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:40.115716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5c5c2062-2f65-462c-aab9-b8fef4656160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:40.212080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 682/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:40.498977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:40.500541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:40.605572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873aa5-3c3b-44b0-a90d-0a8d0215a290 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:40.678682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:40.679377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:40.679673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:40.679946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:40.681623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:40.708883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:40.795502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:40.796987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36ca2-b22f-4c6f-b25f-daaf71efb185 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:40.815453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 652/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:43.014285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:43.014850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:43.014850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:43.016241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 683/1335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:43.021464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203844b-2fd7-43a5-84ff-9e38b99b9533 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:43.021906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203844b-2fd7-43a5-84ff-9e38b99b9533 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:43.022053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203844b-2fd7-43a5-84ff-9e38b99b9533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:43.095437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b203844b-2fd7-43a5-84ff-9e38b99b9533 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:43.096693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b203844b-2fd7-43a5-84ff-9e38b99b9533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:43.169586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:43.191488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 653/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:43.494373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:43.495954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:43.605718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5783f-626d-449c-a7b7-6158f0f5efe7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:43.635410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:43.683887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:43.684536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:43.684878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:43.685088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:43.686752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:43.795838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:43.797285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfcd66-a6ed-4fd9-bc47-ee489d9e7894 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:43.815691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 684/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:46.547490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:46.548061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:46.548061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:46.549417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 654/1338] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:46.555337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970a3f-9a2c-4050-a934-4e5894233056 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:46.555789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970a3f-9a2c-4050-a934-4e5894233056 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:46.555902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970a3f-9a2c-4050-a934-4e5894233056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:46.622517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-90970a3f-9a2c-4050-a934-4e5894233056 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:46.623715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-90970a3f-9a2c-4050-a934-4e5894233056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:46.631885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:46.719522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 685/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:46.999761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:47.001350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:47.103488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24be8-438e-471a-9ffa-b39e9540dfe0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:47.174472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:47.175068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:47.175358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:47.175615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:47.177218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:47.213063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:47.285083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:47.286550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b178800-f065-4efe-a1a1-c1d37a770f0f service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:47.305546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 655/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:51.646515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:51.647073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:51.647073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:51.649739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 686/1341] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:51.655147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b836-ac41-4a9f-b962-ed32841a0996 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:51.655567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b836-ac41-4a9f-b962-ed32841a0996 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:51.655692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743b836-ac41-4a9f-b962-ed32841a0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:51.722410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4743b836-ac41-4a9f-b962-ed32841a0996 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:51.723609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4743b836-ac41-4a9f-b962-ed32841a0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:51.811929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:51.823566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 656/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:52.113021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:52.114553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:52.216751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e6e08-fcda-41c1-839a-32488b6d21ee None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:52.255398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:52.295379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:52.296108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:52.296385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:52.296654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:52.298242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:52.406825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:52.408199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773f88c-8483-4c79-844c-c7c5c5769815 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:52.428849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 687/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:01:55.558655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:55.559215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:55.559215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:55.560606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 657/1344] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:01:55.565880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401b3f-e00b-4bdf-9170-2fa837683907 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:55.566292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401b3f-e00b-4bdf-9170-2fa837683907 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:55.566451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401b3f-e00b-4bdf-9170-2fa837683907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:55.640420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c3401b3f-e00b-4bdf-9170-2fa837683907 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:01:55.641645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c3401b3f-e00b-4bdf-9170-2fa837683907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:55.660568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:55.746826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 688/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:01:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:01:56.027711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:01:56.029263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:56.135943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da208ae-244f-4c90-9bfa-b6444712f7b9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:01:56.213393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:01:56.214067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:01:56.214291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:01:56.214562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:01:56.216197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:01:56.263320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:56.349252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:01:56.351428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709da3-233c-4795-a047-f928a13401f2 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:01:56.375458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 658/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:01:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:01.169480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:01.169938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:01.170043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:01.171675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 689/1347] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:01.177340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482558a2-8671-42eb-b8d6-0ca06c9ed05f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:01.177840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482558a2-8671-42eb-b8d6-0ca06c9ed05f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:01.177954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482558a2-8671-42eb-b8d6-0ca06c9ed05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:01.249059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-482558a2-8671-42eb-b8d6-0ca06c9ed05f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:01.250254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-482558a2-8671-42eb-b8d6-0ca06c9ed05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:01.346984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:01.349210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 659/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:01.643519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:01.645092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:01.748489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074014-3208-4898-99e3-80f5ca4fa4d1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:01.798870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:01.824554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:01.825153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:01.825434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:01.825705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:01.827280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:01.935480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:01.936862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680c415-2d54-4131-be78-e69229a98fcc service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:01.954770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 690/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:06.971166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ced-3444-4cd7-9bc8-865503dcdade None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:06.971640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ced-3444-4cd7-9bc8-865503dcdade None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:06.971720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ced-3444-4cd7-9bc8-865503dcdade None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:06.973391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 660/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:06.979308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c990-502f-4ff3-aa2c-64c32045ebc5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:06.979771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c990-502f-4ff3-aa2c-64c32045ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:06.980996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c990-502f-4ff3-aa2c-64c32045ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:07.078566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b508c990-502f-4ff3-aa2c-64c32045ebc5 None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:07.081349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b508c990-502f-4ff3-aa2c-64c32045ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:07.122064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:07.231445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 691/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:02:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:11.591816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583637-171f-4d22-9f22-6a00c276cf4e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:11.592406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583637-171f-4d22-9f22-6a00c276cf4e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:11.592406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583637-171f-4d22-9f22-6a00c276cf4e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:11.593930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 661/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:02:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:11.599682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf70b2-e49c-4a54-901d-cecccf14dc2a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:11.600714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf70b2-e49c-4a54-901d-cecccf14dc2a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:11.601196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf70b2-e49c-4a54-901d-cecccf14dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:11.687657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5baf70b2-e49c-4a54-901d-cecccf14dc2a None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:11.689066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5baf70b2-e49c-4a54-901d-cecccf14dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:11.766748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:11.805400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 692/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:02:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:13.092355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a69c83-4835-4c51-bc6e-7cd310afb19e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:13.092868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a69c83-4835-4c51-bc6e-7cd310afb19e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:13.092991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a69c83-4835-4c51-bc6e-7cd310afb19e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:13.094348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 662/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:13.099686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02d7-be58-44cf-8950-872f6a7dd3bf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:13.100131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02d7-be58-44cf-8950-872f6a7dd3bf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:13.100612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02d7-be58-44cf-8950-872f6a7dd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:13.177583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-eb8c02d7-be58-44cf-8950-872f6a7dd3bf None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:13.179055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-eb8c02d7-be58-44cf-8950-872f6a7dd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:13.295161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 693/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:02:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:16.794260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c262f7-ce71-4027-941b-cf17037c5fa3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:16.795230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c262f7-ce71-4027-941b-cf17037c5fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:16.795940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c262f7-ce71-4027-941b-cf17037c5fa3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:16.797766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 663/1356] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:16.804986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab7b1c-6545-4a8f-87e2-856e489796c4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:16.805486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab7b1c-6545-4a8f-87e2-856e489796c4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:16.805807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab7b1c-6545-4a8f-87e2-856e489796c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:16.847590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:16.882031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-01ab7b1c-6545-4a8f-87e2-856e489796c4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:16.883498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-01ab7b1c-6545-4a8f-87e2-856e489796c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:16.986891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 694/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:17.287009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfde3-906e-452f-ab90-417712501455 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:17.288199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfde3-906e-452f-ab90-417712501455 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:17.289054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfde3-906e-452f-ab90-417712501455 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:17.291091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 664/1358] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 08:02:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:17.298585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e6b2-2844-4129-b72d-d3bc4e04e1dc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:17.298872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e6b2-2844-4129-b72d-d3bc4e04e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:17.299225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e6b2-2844-4129-b72d-d3bc4e04e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:17.377219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-12e1e6b2-2844-4129-b72d-d3bc4e04e1dc None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:17.378550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-12e1e6b2-2844-4129-b72d-d3bc4e04e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:17.434115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:17.510747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 695/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 08:02:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:17.518435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfde3-906e-452f-ab90-417712501455 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:17.520042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-afbbfde3-906e-452f-ab90-417712501455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:17.687260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfde3-906e-452f-ab90-417712501455 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:17.772103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:17.814445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:17.815229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:17.815452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:17.815757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:17.817438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:17.925055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:17.926640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c8880-0a23-41f1-8538-b08842d04f84 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:17.947127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 665/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:20.359972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:20.360427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:20.360427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:20.362301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 696/1361] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:20.367783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7cd3-8e2e-4bbe-b43f-52a89afeaf90 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:20.367783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7cd3-8e2e-4bbe-b43f-52a89afeaf90 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:20.368681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7cd3-8e2e-4bbe-b43f-52a89afeaf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:20.447668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-428c7cd3-8e2e-4bbe-b43f-52a89afeaf90 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:20.447668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-428c7cd3-8e2e-4bbe-b43f-52a89afeaf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:20.486988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:20.549636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 666/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:20.837781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:20.839327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:21.013449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211493cd-d9c8-4577-9a61-7b2767afd526 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:21.025977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:21.161119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:21.161729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:21.162011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:21.162339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:21.164134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:21.258566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:21.260143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15595-a374-41bb-9360-1703d69151e8 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:21.278921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 697/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:23.958551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aad09-511f-4116-80f5-acb5dd014925 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:23.959686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aad09-511f-4116-80f5-acb5dd014925 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:23.959686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aad09-511f-4116-80f5-acb5dd014925 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:23.961069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 667/1364] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:23.966455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73771b1-ef1d-4a17-97e9-421f699bda0d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:23.966900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73771b1-ef1d-4a17-97e9-421f699bda0d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:23.966995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73771b1-ef1d-4a17-97e9-421f699bda0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:23.983342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:24.038608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b73771b1-ef1d-4a17-97e9-421f699bda0d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:24.039833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b73771b1-ef1d-4a17-97e9-421f699bda0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:24.144866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 698/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:02:24.440228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:24.440804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:24.441186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:24.444054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 668/1366] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 08:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:24.453364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71e35-f62e-4ab5-861b-70dd10e62cc0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:24.453871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71e35-f62e-4ab5-861b-70dd10e62cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:24.454258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71e35-f62e-4ab5-861b-70dd10e62cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:24.532830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4ca71e35-f62e-4ab5-861b-70dd10e62cc0 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:24.534108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4ca71e35-f62e-4ab5-861b-70dd10e62cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:24.573289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:24.660065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 699/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 08:02:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:24.668227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:24.669814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:24.830700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6f50-f932-48a1-9318-276bf6a6aa87 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:24.852192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:24.954729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:24.955360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:24.955645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:24.955919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:24.957845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:25.075199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195044-c455-482c-a544-b7d016626afd None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:25.076385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195044-c455-482c-a544-b7d016626afd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:25.076900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195044-c455-482c-a544-b7d016626afd None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:25.079667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 700/1368] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:02:25.079782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:25.081518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdae7c-4d01-4bfb-ad6e-5cf34e72800e service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:25.085367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625317c5-79b6-40c8-84ea-0b9a8ecc1265 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:25.085718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625317c5-79b6-40c8-84ea-0b9a8ecc1265 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:25.085992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625317c5-79b6-40c8-84ea-0b9a8ecc1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:25.103073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 669/1369] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:25.156146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-625317c5-79b6-40c8-84ea-0b9a8ecc1265 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:25.157359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-625317c5-79b6-40c8-84ea-0b9a8ecc1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:25.260233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:25.280029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 701/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:02:25.607456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:25.607456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:25.607456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:25.608565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 670/1371] 10.222.0.43 () {54 vars in 964 bytes} [Tue Sep 13 08:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:25.612949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0954b-ec52-4668-9fec-61678d693888 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:25.613241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0954b-ec52-4668-9fec-61678d693888 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:25.613519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0954b-ec52-4668-9fec-61678d693888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:25.697380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9cb0954b-ec52-4668-9fec-61678d693888 None None] MFA Rules not processed for user `840b8207e53043a8bab349f03f6ac109`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:25.699750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9cb0954b-ec52-4668-9fec-61678d693888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:25.791535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 702/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Sep 13 08:02:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:25.799417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:25.800946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:25.834798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:25.920125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02116-b302-4dfe-be10-d6e22a6a7e8f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:26.007245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:26.007779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:26.008094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:26.008520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:26.010131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:26.101351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:26.135174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:26.136678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc3d23-2d15-4da0-8732-cee27adb2106 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:26.155411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 671/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:27.514249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:27.514780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:27.514780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:27.516510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 703/1374] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:27.521942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf66b3-7dcc-451b-a23c-53b518c6909d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:27.522390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf66b3-7dcc-451b-a23c-53b518c6909d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:27.522564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf66b3-7dcc-451b-a23c-53b518c6909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:27.590394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b3cf66b3-7dcc-451b-a23c-53b518c6909d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:27.591593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b3cf66b3-7dcc-451b-a23c-53b518c6909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:27.691633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 672/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:27.997533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:27.999138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:28.090902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:28.156118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb3ffb-05b5-4e8a-9432-a21991b90b92 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:28.280759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:28.280971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:28.281591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:28.281591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:28.283088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:28.333063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:28.375489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:28.377113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5e9a-ee5d-4523-96d7-3df258059a78 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:28.395040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 704/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:30.765305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:30.765846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:30.766150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:30.767788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 673/1377] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:30.773515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236e73-236c-44ea-8b1e-69d121700316 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:30.773958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236e73-236c-44ea-8b1e-69d121700316 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:30.774139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236e73-236c-44ea-8b1e-69d121700316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:30.842996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1f236e73-236c-44ea-8b1e-69d121700316 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:30.844303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f236e73-236c-44ea-8b1e-69d121700316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:30.942714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 705/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:31.235033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:31.236580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:31.286524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:31.407065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5771-6ce3-401d-9365-e3cab3bd9b33 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:31.525489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:31.531059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:31.531664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:31.531940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:31.532244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:31.533968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:31.633774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:31.635495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7da1d1-23a9-4647-a9fe-b2204234195d service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:31.656778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 674/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:34.033823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:34.037572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:34.037572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:34.037572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 706/1380] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:34.041510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc3aa-3f2e-418b-b348-bb38a1936cf6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:34.041953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc3aa-3f2e-418b-b348-bb38a1936cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:34.042070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bc3aa-3f2e-418b-b348-bb38a1936cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:34.114943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-402bc3aa-3f2e-418b-b348-bb38a1936cf6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:34.116683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-402bc3aa-3f2e-418b-b348-bb38a1936cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:34.200101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:34.234376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 675/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:34.677234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:34.678956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:34.713446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:34.843882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c725573-1e7e-4458-bb01-3c6788e92cc2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:34.946841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:34.964230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:34.964780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:34.965068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:34.965336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:34.967088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:35.067514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:35.069744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324697fa-8139-4d6f-a1a8-56f903e2c12f service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:35.088571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 707/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:37.414407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:37.415034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:37.415034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:37.416353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 676/1383] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:37.421943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4714e1-1a89-493d-951b-8fb90e2ca5a0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:37.422470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4714e1-1a89-493d-951b-8fb90e2ca5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:37.422470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4714e1-1a89-493d-951b-8fb90e2ca5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:37.495051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2a4714e1-1a89-493d-951b-8fb90e2ca5a0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:37.496433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2a4714e1-1a89-493d-951b-8fb90e2ca5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:37.559809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:37.599775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 708/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:38.031957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:38.034057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:38.220212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8ce7-b12e-4808-b50e-e09320b8b0d4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:38.289429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:38.355329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:38.355947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:38.356264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:38.356540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:38.358174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:38.452217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:38.453832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd24eb-8d70-4056-b57f-2e3a8ed3d054 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:38.473419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 677/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:40.912353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:40.912915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:40.912915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:40.914184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 709/1386] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:02:40.919735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5da6-2630-4ed0-b1f8-c80188c2557b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:40.920165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5da6-2630-4ed0-b1f8-c80188c2557b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:40.920321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5da6-2630-4ed0-b1f8-c80188c2557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:40.987130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-22da5da6-2630-4ed0-b1f8-c80188c2557b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:40.988360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22da5da6-2630-4ed0-b1f8-c80188c2557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:40.997258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:41.085639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 678/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:41.388530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:41.390061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:41.542199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ec5b-9f11-4904-afb9-25ccf363bbc4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:41.589708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:41.658613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:41.659216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:41.659494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:41.659774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:41.661646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:41.753717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:41.755375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3743f21-6e14-451e-b252-2fbda9ebb640 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:41.776520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 710/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:41.861820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329132-bf6b-4ee4-a02e-e412a1661663 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:41.862033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329132-bf6b-4ee4-a02e-e412a1661663 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:41.862411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329132-bf6b-4ee4-a02e-e412a1661663 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:41.864041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 679/1389] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:41.870924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280b4d-7787-43ee-b0ee-b2335771d5e3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:41.871235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280b4d-7787-43ee-b0ee-b2335771d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:41.871512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280b4d-7787-43ee-b0ee-b2335771d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:41.938177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:41.940800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-69280b4d-7787-43ee-b0ee-b2335771d5e3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:41.941996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69280b4d-7787-43ee-b0ee-b2335771d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:42.046827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 711/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:42.355503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:42.355960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:42.356218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:42.357649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 680/1391] 10.222.0.43 () {54 vars in 966 bytes} [Tue Sep 13 08:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:42.362777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73085-2bfb-48a1-a7f5-65caf4a2c9d3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:42.363139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73085-2bfb-48a1-a7f5-65caf4a2c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:42.363504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73085-2bfb-48a1-a7f5-65caf4a2c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:42.441823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-58f73085-2bfb-48a1-a7f5-65caf4a2c9d3 None None] MFA Rules not processed for user `7ff9dd1806ea4e4bbc4036bfeaeb9856`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:42.443587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-58f73085-2bfb-48a1-a7f5-65caf4a2c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:42.513943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:42.519731 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 712/1392] 10.222.0.43 () {58 vars in 1063 bytes} [Tue Sep 13 08:02:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:42.534665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:42.534665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:42.636558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23a2a7-75b0-477b-818e-6d5174b74faf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:42.674167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:42.711718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:42.712355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:42.712639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:42.712910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:42.714514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:42.823289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:42.824775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ed449-17a0-464c-9b82-fc8e1aa1d93b service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:42.847086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 681/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:43.735536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969319-bf22-4222-8869-032c6f7ea4b0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:43.736011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969319-bf22-4222-8869-032c6f7ea4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:43.736154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969319-bf22-4222-8869-032c6f7ea4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:43.804606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4f969319-bf22-4222-8869-032c6f7ea4b0 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:43.805803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4f969319-bf22-4222-8869-032c6f7ea4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:43.894427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 713/1394] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:02:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:43.943513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:43.944044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:43.944250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:43.945613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 682/1395] 10.222.0.43 () {54 vars in 943 bytes} [Tue Sep 13 08:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:43.952131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2f9c-5f8b-4edf-b2e5-4819dabd3d6a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:43.952428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2f9c-5f8b-4edf-b2e5-4819dabd3d6a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:43.952700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2f9c-5f8b-4edf-b2e5-4819dabd3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:44.029023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6c3b2f9c-5f8b-4edf-b2e5-4819dabd3d6a None None] MFA Rules not processed for user `085da9bf0ef94bf89f7254dd67301a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:44.030223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c3b2f9c-5f8b-4edf-b2e5-4819dabd3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.061192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:44.147221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 714/1396] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Sep 13 08:02:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:44.156504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:44.158030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.172526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5699b1b-5997-4695-953d-cb3ed8a62b84 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:44.172814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5699b1b-5997-4695-953d-cb3ed8a62b84 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:44.173084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5699b1b-5997-4695-953d-cb3ed8a62b84 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:44.174574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 715/1397] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:02:44.179745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:44.180056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:44.180336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:44.232012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:44.246964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:44.248219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.297734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989e30f-c0ac-4f25-adb0-1623afedce86 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:44.345408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:44.348451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 716/1398] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:02:44.407308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:44.407832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:44.408145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:44.408417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:44.410029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.463626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:44.493023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:44.494651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad99a-aa1a-4a9c-8124-e643ed16de3a service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:44.503375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 683/1399] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:02:44.647231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:44.651461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.768647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cc143-a8c7-418e-82ef-da96f35b1e30 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:44.887956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:44.896159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:44.896780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:44.897056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:44.897324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:44.898988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:44.994411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:44.995947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc9300-4fde-4973-8e6d-92e8d57f09fd service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:45.022489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 717/1400] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:47.439839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:47.440381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:47.440381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:47.444027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 684/1401] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:47.448431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae7-8a98-404c-96ae-4c04f6bf3def None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:47.449449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae7-8a98-404c-96ae-4c04f6bf3def None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:47.449740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae7-8a98-404c-96ae-4c04f6bf3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:47.527394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8f77aae7-8a98-404c-96ae-4c04f6bf3def None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:47.528924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8f77aae7-8a98-404c-96ae-4c04f6bf3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:47.596090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:47.640024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 718/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:47.939338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:47.940909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:48.111246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45b1c4-e3ef-4479-8775-8fbb5e20cd2c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:48.172500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:48.251391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:48.251917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:48.252232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:48.252502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:48.254122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:48.363990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:48.365863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541f63d-1b49-4ee0-945e-a597f00e1758 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:48.386076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 685/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:50.946220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:50.946846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:50.946846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:50.948372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 719/1404] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:50.953842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a604-5b26-4e4e-86a3-06bde6d1d696 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:50.954372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a604-5b26-4e4e-86a3-06bde6d1d696 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:50.954372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6a604-5b26-4e4e-86a3-06bde6d1d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:51.024423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-04e6a604-5b26-4e4e-86a3-06bde6d1d696 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:51.025678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-04e6a604-5b26-4e4e-86a3-06bde6d1d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:51.028012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:51.148035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 686/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:02:51.433710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:51.435236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:51.597660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d678b-d8e1-4af2-9e0c-ce773b312879 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:51.655078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:51.725161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:51.725939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:51.726326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:51.726687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:51.728411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:51.833757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:51.835472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56afdd-5b26-4a5d-833f-7bbec2b9f038 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:51.855008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 720/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:02:54.247275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:54.247864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:54.247864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:54.249414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 687/1407] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:02:54.255074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c345-70ba-4fc7-b7a9-67a99888f6d4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:54.255605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c345-70ba-4fc7-b7a9-67a99888f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:54.255886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c345-70ba-4fc7-b7a9-67a99888f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:54.338947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6f39c345-70ba-4fc7-b7a9-67a99888f6d4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:02:54.340483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6f39c345-70ba-4fc7-b7a9-67a99888f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:54.357132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:54.510842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 721/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:02:54.820028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:02:54.821549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:54.968622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:54.985877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df352b-31b3-4971-a4bf-4dba8bdaab52 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:02:55.115747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:02:55.116308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:02:55.116582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:02:55.116851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:02:55.118465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:02:55.216507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:02:55.218101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73b1d-34c3-43c8-8da9-383ad94869af service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:02:55.222934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:55.236947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 688/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:04.744527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=40 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:05.260930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:08.340441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021f2d-844e-4728-9e60-f4c94bf15d9d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:08.340997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021f2d-844e-4728-9e60-f4c94bf15d9d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:08.340997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021f2d-844e-4728-9e60-f4c94bf15d9d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:08.342332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 722/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Sep 13 08:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:08.347245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c52a-1fc7-44a7-a9a8-e6b156dd72ae None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:08.347675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c52a-1fc7-44a7-a9a8-e6b156dd72ae None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:08.347783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c52a-1fc7-44a7-a9a8-e6b156dd72ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:08.423629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8047c52a-1fc7-44a7-a9a8-e6b156dd72ae None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:08.424922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8047c52a-1fc7-44a7-a9a8-e6b156dd72ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:08.531267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 689/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:08.545653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860636a2-b940-48eb-aca9-f3f08aa6b6b9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:08.546230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860636a2-b940-48eb-aca9-f3f08aa6b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:08.546529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860636a2-b940-48eb-aca9-f3f08aa6b6b9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:08.547848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 723/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Sep 13 08:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:08.552737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13661ad-a616-4584-b5da-bb36df9c2e97 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:08.553022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13661ad-a616-4584-b5da-bb36df9c2e97 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:08.553327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13661ad-a616-4584-b5da-bb36df9c2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:08.626385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:08.629392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d13661ad-a616-4584-b5da-bb36df9c2e97 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:08.630593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d13661ad-a616-4584-b5da-bb36df9c2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:08.747159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 690/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:11.359117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:11.359531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:11.359672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:11.361051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:11.366927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da589-d473-4e4f-8b87-4caa56a09135 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:11.367377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da589-d473-4e4f-8b87-4caa56a09135 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:11.367496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da589-d473-4e4f-8b87-4caa56a09135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:11.434960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2c3da589-d473-4e4f-8b87-4caa56a09135 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:11.436224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2c3da589-d473-4e4f-8b87-4caa56a09135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:11.491458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:11.533432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:03:11.826620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:11.828157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:11.970978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd076b-0e0d-402a-80ce-fb786ee05558 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:12.042928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:12.086451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:12.086977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:12.087250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:12.087560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:12.089196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:12.181934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:12.183543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2180-a4ac-4d96-99c2-7626b85528d2 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:12.200763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 725/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:13.342885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:13.343399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:13.343498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:13.344832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:13.351433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70828e-72dc-4345-81ce-7ba9373893bf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:13.351881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70828e-72dc-4345-81ce-7ba9373893bf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:13.352018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70828e-72dc-4345-81ce-7ba9373893bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:13.427855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0d70828e-72dc-4345-81ce-7ba9373893bf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:13.429093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0d70828e-72dc-4345-81ce-7ba9373893bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:13.456632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:13.530707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:13.685629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:13.690764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:13.832704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042db74c-ce21-4b7f-8510-8215666ef9a2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:13.873225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:13.946278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:13.946880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:13.947158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:13.947434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:13.949107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:14.041078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:14.042667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fab87-5da9-4d4e-a27d-0cc5a3599d32 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:14.061105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 693/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:15.198655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:15.199131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:15.199238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:15.200599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:15.206707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d04f-51b1-41fc-814c-c02878d15745 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:15.207173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d04f-51b1-41fc-814c-c02878d15745 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:15.207283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d04f-51b1-41fc-814c-c02878d15745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:15.260932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:15.283038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2bb2d04f-51b1-41fc-814c-c02878d15745 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:15.284266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2bb2d04f-51b1-41fc-814c-c02878d15745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:15.390723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:15.542310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:15.543810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:15.689006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390763-ca2f-41be-b29f-e9860086c645 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:15.702898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:15.809878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:15.810376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:15.810650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:15.810918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:15.812514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:15.901013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:15.902589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18736c1-3c3a-4a3a-b167-4692d4aee159 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:15.920351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 728/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:17.041926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:17.042512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:17.042512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:17.043814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:17.050632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac2de-5454-41dc-9fa8-9198a74ed0ba None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:17.051089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac2de-5454-41dc-9fa8-9198a74ed0ba None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:17.051190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac2de-5454-41dc-9fa8-9198a74ed0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:17.075119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:17.129403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5adac2de-5454-41dc-9fa8-9198a74ed0ba None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:17.131694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5adac2de-5454-41dc-9fa8-9198a74ed0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:17.228616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:17.387383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:17.388945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:17.506834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:17.542576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9903160-304e-462e-9534-b9f76def24a4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:17.656257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:17.656782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:17.657057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:17.657325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:17.658918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:17.748081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:17.761427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:17.763021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5955e-62ec-486e-a816-effc59321298 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:17.781920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 696/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:18.892983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:18.893526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:18.893526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:18.894861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:18.901285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2f07-38f1-400b-8242-c9b30fd7ea15 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:18.901701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2f07-38f1-400b-8242-c9b30fd7ea15 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:18.905178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2f07-38f1-400b-8242-c9b30fd7ea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:18.979911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c54a2f07-38f1-400b-8242-c9b30fd7ea15 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:18.981136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c54a2f07-38f1-400b-8242-c9b30fd7ea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:19.077867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:19.227802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:19.229381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:19.313085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:19.373156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d7980-f911-4875-b252-0241a6f27c91 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:19.484838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:19.485445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:19.485724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:19.485994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:19.487580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:19.537608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:19.578458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:19.580062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4294f-93e3-4a27-9018-3fc99e56cb8a service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:19.597557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 731/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:20.743135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:20.743754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:20.743754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:20.745139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:20.751514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b01-0a6a-4aee-afb9-123b073fd331 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:20.751944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b01-0a6a-4aee-afb9-123b073fd331 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:20.752139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b01-0a6a-4aee-afb9-123b073fd331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:20.827908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1f589b01-0a6a-4aee-afb9-123b073fd331 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:20.829215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f589b01-0a6a-4aee-afb9-123b073fd331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:20.923512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:21.074034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:21.075552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:21.124900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:21.220503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ba16-91af-42d9-ada1-b8a7cafa35cb None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:21.335916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:21.336489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:21.336764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:21.337031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:21.338649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:21.345498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:21.427253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:21.429058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58979c02-d59a-4f52-ab92-8c1b2a27b3d2 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:21.446870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 699/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:22.608015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:22.608584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:22.608584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:22.609931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:22.617011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d71c-fe89-4a34-8907-3bb812489155 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:22.617487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d71c-fe89-4a34-8907-3bb812489155 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:22.617681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d71c-fe89-4a34-8907-3bb812489155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:22.715317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-13e4d71c-fe89-4a34-8907-3bb812489155 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:22.716567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-13e4d71c-fe89-4a34-8907-3bb812489155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:22.783459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:22.813409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:03:22.972958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:22.974480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:22.993627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:23.120261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072cc07-43d9-40e9-bef3-2e38fe78cdb4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:23.204240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:23.229681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:23.230282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:23.230560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:23.230829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:23.232436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:23.330431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:23.332055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b4fe9-9e14-4f89-987d-12fb53cc27fe service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:23.350294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 734/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:24.502393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:24.502818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:24.502955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:24.504369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:24.511161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29bf1a-6562-4e49-9992-699561dc2945 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:24.511608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29bf1a-6562-4e49-9992-699561dc2945 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:24.511712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29bf1a-6562-4e49-9992-699561dc2945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:24.585965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6e29bf1a-6562-4e49-9992-699561dc2945 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:24.587170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6e29bf1a-6562-4e49-9992-699561dc2945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:24.628032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:24.683033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:24.832792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:24.834426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:24.980585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893dd80-27f8-499b-a60d-2a201cd83d3b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:25.035277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:25.094273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:25.094885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:25.095167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:25.095436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:25.097077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:25.185254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:25.186843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823df7a1-701a-4a5b-b69e-5b1f693b642b service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:25.204877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 702/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:26.321042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:26.321567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:26.321678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:26.322970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:26.329372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5341f12-905b-4839-8640-41a58d59c059 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:26.329808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5341f12-905b-4839-8640-41a58d59c059 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:26.329929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5341f12-905b-4839-8640-41a58d59c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:26.405420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e5341f12-905b-4839-8640-41a58d59c059 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:26.406622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e5341f12-905b-4839-8640-41a58d59c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:26.408702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:26.503921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:26.656791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:26.658331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:26.801488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840318ff-be7a-4f91-9d71-6da6d83fc398 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:26.828232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:26.913114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:26.913649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:26.914131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:26.914630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:26.916877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:27.005028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:27.007220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591a89d-664e-4e9c-ab67-3f5b1fdf7de8 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:27.024853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 737/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:29.108748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:29.109310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:29.109310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:29.110656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:29.115909 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff9be-4c3d-4ae7-88f9-d1504ac68d06 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:29.116336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff9be-4c3d-4ae7-88f9-d1504ac68d06 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:29.116510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff9be-4c3d-4ae7-88f9-d1504ac68d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:29.157559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:29.182523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-041ff9be-4c3d-4ae7-88f9-d1504ac68d06 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:29.183723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-041ff9be-4c3d-4ae7-88f9-d1504ac68d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:29.278456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:29.568613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:29.570151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:29.672895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460d975-df42-4222-948b-ee7b3f2443ae None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:29.705586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:29.746485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:29.747091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:29.747369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:29.747639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:29.749257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:29.856081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:29.857487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6fd21-d757-4509-9bd6-df1ddac83aa5 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:29.876401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 705/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:32.258962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:32.259548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:32.259548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:32.261005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:32.266511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc36d-83c4-4878-8326-b7542007ff33 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:32.266964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc36d-83c4-4878-8326-b7542007ff33 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:32.267077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc36d-83c4-4878-8326-b7542007ff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:32.332894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c48bc36d-83c4-4878-8326-b7542007ff33 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:32.334748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c48bc36d-83c4-4878-8326-b7542007ff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:32.347159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:32.433440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:03:32.723603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:32.725284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:32.831162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc375006-4f91-441c-a7a1-96145db1ac18 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:32.843707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:32.904951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:32.905554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:32.905832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:32.906105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:32.907727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:33.022735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:33.024433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e88c0-1a04-48cd-83b3-53636d67be78 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:33.043441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 740/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:35.569472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:35.570037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:35.570037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:35.571391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:35.576918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfc460-aebf-493a-b5c9-2dac7cdeb904 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:35.577348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfc460-aebf-493a-b5c9-2dac7cdeb904 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:35.577463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfc460-aebf-493a-b5c9-2dac7cdeb904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:35.625979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:35.647329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-81bfc460-aebf-493a-b5c9-2dac7cdeb904 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:35.648589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-81bfc460-aebf-493a-b5c9-2dac7cdeb904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:35.748305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:36.034970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:36.038823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:36.140465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad92ae-75b1-4226-8eaa-2fd8ef3efd57 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:36.185768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:36.221405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:36.222010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:36.222291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:36.222564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:36.224306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:36.333965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:36.335787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ab7ab-2c80-4265-8770-587dc91171d5 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:36.354668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 708/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:38.672940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:38.673484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:38.673484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:38.674829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:38.680960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269cd99-0ce5-4c06-813f-93764716461f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:38.681353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269cd99-0ce5-4c06-813f-93764716461f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:38.681507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269cd99-0ce5-4c06-813f-93764716461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:38.748356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d269cd99-0ce5-4c06-813f-93764716461f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:38.750937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d269cd99-0ce5-4c06-813f-93764716461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:38.770299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:38.847703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:39.131902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:39.133481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:39.236488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b369-4682-4a60-8125-14d1eba0df8f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:39.257869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:39.312568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:39.313176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:39.313458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:39.313733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:39.315325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:39.423208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:39.424587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d1140-64c8-43f6-9095-4f0224096188 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:39.442728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 743/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:41.877695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:41.878264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:41.878264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:41.879623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:41.885660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d0f9-8d0a-4ae8-8437-515bfe546851 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:41.886116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d0f9-8d0a-4ae8-8437-515bfe546851 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:41.886221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d0f9-8d0a-4ae8-8437-515bfe546851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:41.954324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:41.956968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ad17d0f9-8d0a-4ae8-8437-515bfe546851 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:41.958301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ad17d0f9-8d0a-4ae8-8437-515bfe546851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:42.053275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:42.352746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:42.354335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:42.457433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa40c1-61ad-4487-836c-37af78de03ec None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:42.506420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:42.530689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:42.531225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:42.531502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:42.531774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:42.533492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:42.643349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:42.644810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c8cf4-b893-4631-9c48-53a3e9699ebb service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:42.663516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 711/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:44.897651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:44.898249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:44.898249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:44.899525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:44.904978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfef5-8abe-4d14-950b-2e8debdfdea7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:44.905388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfef5-8abe-4d14-950b-2e8debdfdea7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:44.905548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfef5-8abe-4d14-950b-2e8debdfdea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:44.970847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2afdfef5-8abe-4d14-950b-2e8debdfdea7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:44.972063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2afdfef5-8abe-4d14-950b-2e8debdfdea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:45.000783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:45.067289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:45.355490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:45.357048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:45.460356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703a273-75b3-4703-8174-2b43cdc26196 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:45.488365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:45.534340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:45.534944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:45.535222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:45.535496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:45.537538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:45.648091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:45.649512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6c011-c113-47dd-bfb4-5ae5ca579a77 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:45.785999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 746/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:48.016780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:48.017383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:48.017383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:48.018711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:48.024577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934147e-d510-418d-aed6-f8f1e690e1f8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:48.024968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934147e-d510-418d-aed6-f8f1e690e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:48.025121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934147e-d510-418d-aed6-f8f1e690e1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:48.093808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f934147e-d510-418d-aed6-f8f1e690e1f8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:48.095048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f934147e-d510-418d-aed6-f8f1e690e1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:48.103768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:48.191727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:48.482443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:48.484020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:48.588729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe8b1-9f8d-4642-a2a2-f0215cfea20b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:48.644417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:48.662873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:48.668006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:48.668006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:48.668006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:48.668006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:48.777722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:48.779275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b3445-dfa3-4b98-8ef9-cc04f93213bc service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:48.798635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 714/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:50.999540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:51.000395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:51.000395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:51.001538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:51.008461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f246-7ae6-46c7-85c7-d4a35f20b274 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:51.008971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f246-7ae6-46c7-85c7-d4a35f20b274 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:51.009082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f246-7ae6-46c7-85c7-d4a35f20b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:51.075958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-13b3f246-7ae6-46c7-85c7-d4a35f20b274 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:51.077183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-13b3f246-7ae6-46c7-85c7-d4a35f20b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:51.116636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:51.185061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:51.486236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:51.487767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:51.590717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01125e6-7d9d-4082-ac6c-88723c2b8f9a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:51.629016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:51.664163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:51.664791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:51.665075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:51.665348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:51.666942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:51.780577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:51.782007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dcb9b-692e-4fb2-9e08-a54df4894adb service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:51.799700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 749/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:53.990837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:53.991422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:53.991422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:53.992780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:53.998650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb16d-c0f0-41cb-b111-ff801fc35800 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:53.999147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb16d-c0f0-41cb-b111-ff801fc35800 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:53.999248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fb16d-c0f0-41cb-b111-ff801fc35800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:54.066897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-889fb16d-c0f0-41cb-b111-ff801fc35800 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:54.068730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-889fb16d-c0f0-41cb-b111-ff801fc35800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:54.086240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:54.165353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:54.450971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:54.452544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:54.557673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7584-87f4-471a-8994-485e82e3bb27 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:54.623621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:54.630370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:54.630985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:54.631269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:54.631546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:54.633196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:54.743973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:54.745446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc5d2d-79b9-4832-a0f4-312f77c42a68 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:54.763494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 717/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:03:56.948187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:56.948748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:56.948748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:56.950098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:03:56.955423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a75-6cf9-4b27-a871-c35326511c88 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:56.955899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a75-6cf9-4b27-a871-c35326511c88 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:56.956026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750a75-6cf9-4b27-a871-c35326511c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:57.021485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-69750a75-6cf9-4b27-a871-c35326511c88 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:03:57.022599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-69750a75-6cf9-4b27-a871-c35326511c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:57.070943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:57.118183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:03:57.403313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:03:57.404902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:57.509699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64bb6c-efee-4178-b33b-f385046ade47 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:03:57.557938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:57.583280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:03:57.584219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:03:57.584502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:03:57.584771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:03:57.586432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:03:57.694564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:03:57.696062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ee22b-81a5-4a69-85ff-967d66a51501 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:03:57.714513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 752/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:07.116664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=22 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:07.712353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=66 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:17.919134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e5b6-cd68-4f5b-ade8-2b59cc1a40a0 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:17.919712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e5b6-cd68-4f5b-ade8-2b59cc1a40a0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:17.919712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e5b6-cd68-4f5b-ade8-2b59cc1a40a0 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:17.921065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 719/1471] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:17.927223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d955-7cb4-4a7e-a57e-4b6134f618a7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:17.927682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d955-7cb4-4a7e-a57e-4b6134f618a7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:17.927787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40d955-7cb4-4a7e-a57e-4b6134f618a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:17.992004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0e40d955-7cb4-4a7e-a57e-4b6134f618a7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:17.993231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0e40d955-7cb4-4a7e-a57e-4b6134f618a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:18.095746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 753/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:18.415429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:18.415707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:18.415997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:18.417355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 720/1473] 10.222.0.43 () {54 vars in 966 bytes} [Tue Sep 13 08:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:18.422894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d09f-40c6-4a23-ba33-10f299a1a08c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:18.423182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d09f-40c6-4a23-ba33-10f299a1a08c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:18.423460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d09f-40c6-4a23-ba33-10f299a1a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:18.501902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2f29d09f-40c6-4a23-ba33-10f299a1a08c None None] MFA Rules not processed for user `7ff9dd1806ea4e4bbc4036bfeaeb9856`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:18.503117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2f29d09f-40c6-4a23-ba33-10f299a1a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:18.524721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:18.580040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 754/1474] 10.222.0.43 () {58 vars in 1063 bytes} [Tue Sep 13 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:18.588725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:18.590232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:18.713720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871d443-1dcf-4b6a-b71a-2a37ed0485e9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:18.790242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:18.790850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:18.791126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:18.791395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:18.793055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:18.851752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:18.906986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:18.908542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf16213-e33b-4761-9354-1607affdd3d5 service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:18.928360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 721/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:21.181166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:21.181747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:21.181747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:21.183035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 755/1476] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:21.188458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714de46-1175-4fad-a42f-0370131ca23c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:21.188902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714de46-1175-4fad-a42f-0370131ca23c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:21.189010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714de46-1175-4fad-a42f-0370131ca23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:21.259720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3714de46-1175-4fad-a42f-0370131ca23c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:21.260981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3714de46-1175-4fad-a42f-0370131ca23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:21.357364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 722/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:21.635171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:21.636742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:21.763069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef695f8-029e-4a85-b2c2-c54a9eb350b5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:21.813011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:21.856503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:21.857136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:21.857416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:21.857687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:21.858316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:21.860111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:04:21.860111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:04:21.860111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:04:21.861240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe11cd-def6-4564-9c36-d22f29ecb730 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:21.881658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 756/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Sep 13 08:04:21 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:04:24.100958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:24.101548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:24.101548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:24.102876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 723/1479] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:24.108362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde3ceb-2f39-4e13-b50a-618297f3173e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:24.108819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde3ceb-2f39-4e13-b50a-618297f3173e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:24.108931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde3ceb-2f39-4e13-b50a-618297f3173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:24.175488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cdde3ceb-2f39-4e13-b50a-618297f3173e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:24.177304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cdde3ceb-2f39-4e13-b50a-618297f3173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:24.278858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 757/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:24.579311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:24.580854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:24.590688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:24.727014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b3eb-1eb6-48d1-92e8-cbfe03874511 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:24.806951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:24.839731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:24.840360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:24.840642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:24.840941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:24.842532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:25.053571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:25.055148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f6985-534a-4022-b4fd-797c570333c9 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:25.073318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 724/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:27.409357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:27.409922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:27.409922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:27.411961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 758/1482] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:27.417294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14995b-a818-486f-b8c4-dd58c6c9b9b9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:27.417714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14995b-a818-486f-b8c4-dd58c6c9b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:27.417844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14995b-a818-486f-b8c4-dd58c6c9b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:27.488347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ea14995b-a818-486f-b8c4-dd58c6c9b9b9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:27.490135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ea14995b-a818-486f-b8c4-dd58c6c9b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:27.537424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:27.586677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 725/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:27.873558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:27.875093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:27.900644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:27.980887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880923b7-f1ec-4eeb-9058-5f14591d9f0f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:28.053614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:28.056096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:28.056096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:28.056096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:28.056418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:28.133290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:28.167844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:28.169304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d491467-4f49-4f8f-957d-554d9b287595 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:28.187951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 759/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:30.382248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770ff1-3004-42ab-b914-97a04067089f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:30.382801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770ff1-3004-42ab-b914-97a04067089f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:30.382801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770ff1-3004-42ab-b914-97a04067089f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:30.384304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 726/1485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:30.389465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0163-9622-4c57-b42a-564a32e5c3b2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:30.389901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0163-9622-4c57-b42a-564a32e5c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:30.390006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0163-9622-4c57-b42a-564a32e5c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:30.455939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4e1e0163-9622-4c57-b42a-564a32e5c3b2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:30.457213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4e1e0163-9622-4c57-b42a-564a32e5c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:30.554118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 760/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:04:30.842078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770ff1-3004-42ab-b914-97a04067089f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:30.843629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-74770ff1-3004-42ab-b914-97a04067089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:30.948856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770ff1-3004-42ab-b914-97a04067089f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:31.019517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:31.021029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:31.021627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:31.021901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:31.022166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:31.023909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:31.132071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:31.133447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605fb52-6f18-4021-b5f0-c49f3e389514 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:31.151208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 727/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:33.433587 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:33.434150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:33.434150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:33.435493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 761/1488] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:33.440847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342282c1-b39a-41d8-907c-aafcb0841ef7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:33.441278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342282c1-b39a-41d8-907c-aafcb0841ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:33.441446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342282c1-b39a-41d8-907c-aafcb0841ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:33.508193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-342282c1-b39a-41d8-907c-aafcb0841ef7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:33.509397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-342282c1-b39a-41d8-907c-aafcb0841ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:33.562144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:33.605712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 728/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:33.892774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:33.894334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:33.930379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:33.997199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c19bb-89d5-42ad-9617-ff6385d44fca None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:34.071845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:34.072505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:34.072842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:34.073118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:34.074719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:34.155717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:34.185387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:34.186895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8c9e3-4ee6-4779-9a86-b7514d2d2811 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:34.204978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 762/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:36.898479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:36.899007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:36.899007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:36.900433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 729/1491] 10.222.0.43 () {54 vars in 927 bytes} [Tue Sep 13 08:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:04:36.905715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ac64-8610-4771-9cff-e5b157ebada7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:36.906150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ac64-8610-4771-9cff-e5b157ebada7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:36.906248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ac64-8610-4771-9cff-e5b157ebada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:36.977959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dad9ac64-8610-4771-9cff-e5b157ebada7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:04:36.979176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dad9ac64-8610-4771-9cff-e5b157ebada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:37.076259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 763/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Sep 13 08:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:04:37.367210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:04:37.368820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:37.473893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52878aa-d349-4e28-80ab-fb0a289cb54d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:04:37.548294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:04:37.548910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:04:37.549219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:04:37.549492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:04:37.551188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:04:37.559802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:37.661538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:04:37.662954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de3402-f778-42e2-b10f-573f0b2dcdeb service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:04:37.683110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 730/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:04:47.074718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=82 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:47.680869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=50 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:00.245651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:00.246248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:00.246248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:00.321820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:06:00.323028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:00.416640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 764/1494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:06:00.424941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:00.425423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:00.425535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:00.500716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:06:00.501847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:00.597216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 731/1495] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:06:00.601925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:00.603123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:00.615087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bb9ce-8112-4046-8f9b-366fbea5d5af None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:00.676042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:00.712252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:00.712868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:00.713146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:00.713417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:00.714056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:06:00.714357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:00.715432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:00.715432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:06:00.715432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:06:00.716354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:00.727921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 765/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:06:00.736509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:00.752290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e346fa-7cf8-4d05-b8c3-5602c1b70ae4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:00.817791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:00.850335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:00.850942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:00.851219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:00.851490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:00.852206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:00.854807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:00.854807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:06:00.854807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:06:00.856025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:00.996946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 732/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:06:00 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:06:01.001667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:01.003269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:01.037451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39550-cfb6-49bf-80d2-89ea92617d80 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:01.131448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:01.132075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:01.132358 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:01.132630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:01.133259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:01.134265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:01.134265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:06:01.134265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:06:01.135460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:01.242080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 766/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:06:01 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:06:01.246328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:01.247841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:01.310902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2beb7f-348a-41fa-a117-790606de4571 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:01.396287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:01.406031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:06:01.409021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:06:01.409671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:01.423391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 733/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:06:01.427539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:01.429127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:01.440653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4ff5-c923-49e5-ab23-610dc6363c17 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:01.466399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:01.536500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:01.537103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:01.537385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:01.537659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:01.538296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:01.539300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:01.539300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:06:01.539300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:06:01.540207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3086ee-8241-4784-97b1-4c6b602b5547 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:01.552754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 767/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:06:01.556924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:01.558431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:01.591647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea18e8d-ef51-449a-a4d3-2d88ffbf0e14 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:01.683447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:01.684119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:01.684400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:01.684668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] PATH_INFO: `/v3/projects/7151b8e185004d57b2dc518a1810c1a4/users/ab1dd51164ee453388cba6afae2246e0/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:01.708539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7151b8e185004d57b2dc518a1810c1a4, user_id=ab1dd51164ee453388cba6afae2246e0, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:01.709321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:01.709321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:06:01.709321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:06:01.711221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8c82-32d0-414d-b34d-ccf103f356df admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:01.842650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 734/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:06:01 2022] PUT /identity/v3/projects/7151b8e185004d57b2dc518a1810c1a4/users/ab1dd51164ee453388cba6afae2246e0/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:06:01.854748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94220d2-9c00-4e20-8e47-00284411230b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:01.855034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94220d2-9c00-4e20-8e47-00284411230b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:01.855310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94220d2-9c00-4e20-8e47-00284411230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:01.911528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b94220d2-9c00-4e20-8e47-00284411230b None None] MFA Rules not processed for user `ab1dd51164ee453388cba6afae2246e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:06:01.912759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b94220d2-9c00-4e20-8e47-00284411230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:01.988978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 768/1502] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:06:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:06:02.002603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:02.002887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:02.003162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:02.004777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 735/1503] 10.222.0.43 () {54 vars in 964 bytes} [Tue Sep 13 08:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:06:02.009679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bb7b-57a4-4942-b8ca-86420850da4e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:02.009955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bb7b-57a4-4942-b8ca-86420850da4e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:02.010224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bb7b-57a4-4942-b8ca-86420850da4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:02.041942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:02.121978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bab4bb7b-57a4-4942-b8ca-86420850da4e None None] MFA Rules not processed for user `840b8207e53043a8bab349f03f6ac109`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:06:02.123088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bab4bb7b-57a4-4942-b8ca-86420850da4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:02.195701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 769/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Sep 13 08:06:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:06:02.203628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:02.205265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:02.254819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:02.309307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b86fb-016f-4f93-a923-cd60d28ec8a2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:02.382817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:02.383341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:02.383617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:02.383889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:02.385497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:02.482684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:02.484137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:02.487543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:02.501336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 736/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:06:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:06:02.547579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10356f-4f8c-4a85-9edd-7fc5ff2f6214 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:02.548025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10356f-4f8c-4a85-9edd-7fc5ff2f6214 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:02.548164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10356f-4f8c-4a85-9edd-7fc5ff2f6214 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:02.549406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 770/1506] 10.222.0.43 () {52 vars in 830 bytes} [Tue Sep 13 08:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:06:02.553108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:02.554297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:02.651323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf0542-1ac0-497d-8b38-49674bf37aeb service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:02.743227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:02.743846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:02.744148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:02.744418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] PATH_INFO: `/v3/users/ab1dd51164ee453388cba6afae2246e0` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:02.757011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1dd51164ee453388cba6afae2246e0)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:02.758031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:02.758031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:06:02.758031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:06:02.759221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:02.768671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:02.971395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1dd51164ee453388cba6afae2246e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:02.996589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1dd51164ee453388cba6afae2246e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:03.011372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1dd51164ee453388cba6afae2246e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:03.011853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1dd51164ee453388cba6afae2246e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:03.093286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1dd51164ee453388cba6afae2246e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:03.099494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 737/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:06:02 2022] DELETE /identity/v3/users/ab1dd51164ee453388cba6afae2246e0 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:06:03.103900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:03.104226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:03.104502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:03.162467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:06:03.163663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:03.238168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:03.249848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 771/1508] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:06:03.260088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:03.261357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:03.362303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469510f-b5b9-4364-9a09-922c12dfba3f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:03.415290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:03.433847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:03.434447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:03.434723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:03.434992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:03.436597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:03.543823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:03.545293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ec397-5a85-4904-bfc2-c35171b82420 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:03.564407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 738/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:06:04.021090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:06:04.022331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:06:04.034268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db950d-4ac5-4fd0-8da1-65315779da45 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:06:04.132554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:06:04.133180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:06:04.133459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:06:04.133725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] PATH_INFO: `/v3/projects/7151b8e185004d57b2dc518a1810c1a4` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:06:04.143381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7151b8e185004d57b2dc518a1810c1a4)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:06:04.144425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:06:04.144425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:06:04.144425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:06:04.146147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:06:04.251667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7151b8e185004d57b2dc518a1810c1a4', 'request_id': 'req-16ff5640-1842-485c-9156-34db7cdf904e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:04.265874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7151b8e185004d57b2dc518a1810c1a4', 'request_id': 'req-16ff5640-1842-485c-9156-34db7cdf904e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:04.272524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7151b8e185004d57b2dc518a1810c1a4', 'request_id': 'req-16ff5640-1842-485c-9156-34db7cdf904e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:04.351299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] The token cache is being invalidate because project 7151b8e185004d57b2dc518a1810c1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:06:04.351522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:04.351928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-16ff5640-1842-485c-9156-34db7cdf904e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:06:04.353360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 772/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:06:04 2022] DELETE /identity/v3/projects/7151b8e185004d57b2dc518a1810c1a4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:06:13.562101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=62 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:14.348727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:37.034704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:37.035291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:37.035291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:37.037157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 739/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:37.042308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1a12-d7f7-40d9-acaf-f71d2b63bd15 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:37.044009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1a12-d7f7-40d9-acaf-f71d2b63bd15 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:37.044009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1a12-d7f7-40d9-acaf-f71d2b63bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:37.124886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ff6c1a12-d7f7-40d9-acaf-f71d2b63bd15 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:37.126155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ff6c1a12-d7f7-40d9-acaf-f71d2b63bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:37.228321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 773/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:37.384887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:37.387688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:37.512037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cc0fd-4a2c-4312-b515-6b67251f153f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:37.517590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:37.518198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:37.518480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:37.518753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:37.527502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:37.529103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30c587-9634-4aab-bd74-38e69183cee0 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:37.538637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 740/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:07:38.638812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660eaac-f291-4256-990f-37ba6ade4afe None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:38.639378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660eaac-f291-4256-990f-37ba6ade4afe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:38.639378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660eaac-f291-4256-990f-37ba6ade4afe None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:38.640776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 774/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:38.647565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ca89-7ce5-4128-86f1-9256a77ab264 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:38.648122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ca89-7ce5-4128-86f1-9256a77ab264 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:38.648417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3ca89-7ce5-4128-86f1-9256a77ab264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:38.668241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-79a3ca89-7ce5-4128-86f1-9256a77ab264 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:38.669450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-79a3ca89-7ce5-4128-86f1-9256a77ab264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:38.678834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 741/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:38.707705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7f96-5dee-4dc1-85ac-64674186ae1d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:38.708093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7f96-5dee-4dc1-85ac-64674186ae1d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:38.708483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7f96-5dee-4dc1-85ac-64674186ae1d None None] PATH_INFO: `/v3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:38.710096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 775/1516] 10.222.0.33 () {54 vars in 925 bytes} [Tue Sep 13 08:07:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:07:38.737790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4179-834d-436b-8fbe-c64a76af4f0d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:38.738072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4179-834d-436b-8fbe-c64a76af4f0d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:38.738347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4179-834d-436b-8fbe-c64a76af4f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:38.807100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7c1f4179-834d-436b-8fbe-c64a76af4f0d None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:38.808347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7c1f4179-834d-436b-8fbe-c64a76af4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:38.837189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a7f96-5dee-4dc1-85ac-64674186ae1d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:38.852803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a7f96-5dee-4dc1-85ac-64674186ae1d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:38.858855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:38.859301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:38.859788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:38.859931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:38.868818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:38.869457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:38.870917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33ab5f-93bb-49ce-ae73-a41e82fa69c3 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:38.881296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 776/1517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:07:38.888425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 742/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 13 08:07:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:42.735595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ff-4e3d-4e0c-958c-f98796b3eaa5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:42.739824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ff-4e3d-4e0c-958c-f98796b3eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:42.739824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d00ff-4e3d-4e0c-958c-f98796b3eaa5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:42.739824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 777/1519] 10.222.0.43 () {54 vars in 961 bytes} [Tue Sep 13 08:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:42.742631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46dd-dfd6-41d7-a0fb-0b4b5aa0f230 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:42.743078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46dd-dfd6-41d7-a0fb-0b4b5aa0f230 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:42.743182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b46dd-dfd6-41d7-a0fb-0b4b5aa0f230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:42.763234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-db4b46dd-dfd6-41d7-a0fb-0b4b5aa0f230 None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:42.764453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-db4b46dd-dfd6-41d7-a0fb-0b4b5aa0f230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:42.773746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 743/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Sep 13 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:42.781455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d00ff-4e3d-4e0c-958c-f98796b3eaa5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:42.795070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d00ff-4e3d-4e0c-958c-f98796b3eaa5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:42.800403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:42.800991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:42.801270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:42.801545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:42.810008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:42.811558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c2079-8a7f-4944-bc9a-3491c358c6e3 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:42.821952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 778/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:07:50.367109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201234a-a4e7-4f60-9f4d-1f0eebcbc0fe None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:50.367674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201234a-a4e7-4f60-9f4d-1f0eebcbc0fe None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:50.367674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201234a-a4e7-4f60-9f4d-1f0eebcbc0fe None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:50.369058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:07:50.375335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb77f4-6238-4c40-8064-684671c370e8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:50.375776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb77f4-6238-4c40-8064-684671c370e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:50.375891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb77f4-6238-4c40-8064-684671c370e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:50.395719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-98cb77f4-6238-4c40-8064-684671c370e8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:50.397208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-98cb77f4-6238-4c40-8064-684671c370e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:50.404990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:50.559192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201234a-a4e7-4f60-9f4d-1f0eebcbc0fe None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:50.574117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201234a-a4e7-4f60-9f4d-1f0eebcbc0fe None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:50.579836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:50.580473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:50.580746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:50.581123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:50.589208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:50.590770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7499-8f73-40ca-ab05-a7ca20e76ce8 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:50.600229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 745/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:07:51.684529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dde45-3ce7-4c49-9eb0-53201087c08e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:51.685118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dde45-3ce7-4c49-9eb0-53201087c08e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:51.685118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dde45-3ce7-4c49-9eb0-53201087c08e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:51.686410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 08:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:51.693046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fed73-3bd4-46e1-b436-d01d6d090155 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:51.693631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fed73-3bd4-46e1-b436-d01d6d090155 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:51.693631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fed73-3bd4-46e1-b436-d01d6d090155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:51.713156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a20fed73-3bd4-46e1-b436-d01d6d090155 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:51.714345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a20fed73-3bd4-46e1-b436-d01d6d090155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:51.722041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 08:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:51.874544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dde45-3ce7-4c49-9eb0-53201087c08e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:51.889459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dde45-3ce7-4c49-9eb0-53201087c08e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:51.894915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:51.896103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:51.896392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:51.896666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:51.904604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:51.906175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca98e1-a8f9-4a45-89a7-065987a4a016 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:51.915511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 781/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:07:56.098130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:56.098755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:56.098755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:56.100118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:56.105705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446bb08-4535-49b1-8bd3-a2c8203ab7e1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:56.106096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446bb08-4535-49b1-8bd3-a2c8203ab7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:56.106271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446bb08-4535-49b1-8bd3-a2c8203ab7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:56.126302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1446bb08-4535-49b1-8bd3-a2c8203ab7e1 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:56.127501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1446bb08-4535-49b1-8bd3-a2c8203ab7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:56.136473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:56.440453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:56.442127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:56.527778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c642-0190-4909-99ce-94180b6d5318 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:56.531344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:56.531949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:56.532257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:56.532531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:56.541782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:56.543210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a0ba4-9969-409a-b22d-d467581e6d6b service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:56.553884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 748/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:07:58.708223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:58.708879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:58.708879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:58.710135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:07:58.716287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebdf1-9dc1-4014-ae15-402e04c6e665 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:58.716840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebdf1-9dc1-4014-ae15-402e04c6e665 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:58.716943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebdf1-9dc1-4014-ae15-402e04c6e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:58.736976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b79ebdf1-9dc1-4014-ae15-402e04c6e665 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:07:58.738175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b79ebdf1-9dc1-4014-ae15-402e04c6e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:58.747525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:07:59.039935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:07:59.041684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:07:59.055491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08ed1-3e34-4821-ac03-4397e8aa55fc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:07:59.059058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:07:59.059654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:07:59.059936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:07:59.060262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:07:59.069839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:07:59.071348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0b6b-76a4-45fa-9676-cdd004ce76b1 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:07:59.080768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 784/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:08:02.789021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:02.789589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:02.789589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:02.790924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:08:02.796280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5533-e402-41ad-94f1-9e5d8d08f5ac None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:02.796704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5533-e402-41ad-94f1-9e5d8d08f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:02.796837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5533-e402-41ad-94f1-9e5d8d08f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:02.805395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:02.818208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2cab5533-e402-41ad-94f1-9e5d8d08f5ac None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:08:02.830863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2cab5533-e402-41ad-94f1-9e5d8d08f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:08:02.830863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:08:03.133107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:08:03.134777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:08:03.211123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e366ed-d567-4e9c-aa7c-cc25ad481c61 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:08:03.214610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:08:03.215204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:03.215485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:03.215753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:03.225057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:08:03.226467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbfea3-93a0-4c53-a669-3e8b8eafe429 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:08:03.235754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 751/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:08:05.392350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:05.392950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:05.392950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:05.394304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 08:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:08:05.399445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07033a4-c162-48c3-8c70-b0555670c758 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:05.399874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07033a4-c162-48c3-8c70-b0555670c758 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:05.400008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07033a4-c162-48c3-8c70-b0555670c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:05.419706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d07033a4-c162-48c3-8c70-b0555670c758 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:08:05.420922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d07033a4-c162-48c3-8c70-b0555670c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:08:05.429648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 08:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:08:05.732986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:08:05.734670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:08:05.749747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc4209-7b37-4f35-a2cf-37d4a1b05e43 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:08:05.753303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:08:05.753900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:08:05.754183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:08:05.754485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:08:05.763436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:08:05.764885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9a5b9-16e0-4c0b-89e2-341348c6398e service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:08:05.774804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 787/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:08:15.414857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:15.770624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:35.719961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae6cc-eaab-437e-b29a-89c5a37dd76b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.721450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae6cc-eaab-437e-b29a-89c5a37dd76b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.721450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae6cc-eaab-437e-b29a-89c5a37dd76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.747188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3ffae6cc-eaab-437e-b29a-89c5a37dd76b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:35.748438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ffae6cc-eaab-437e-b29a-89c5a37dd76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:35.762789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 753/1540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:35.773820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.774420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.774420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.810131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:35.810800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f0e6-8052-4420-9043-773ca674717e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.811092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f0e6-8052-4420-9043-773ca674717e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.811367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88f0e6-8052-4420-9043-773ca674717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.811472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:35.830611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 788/1541] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:35.836261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:35.846958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291105-9457-4279-846a-cf69a5e383bc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:35.847201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-4b88f0e6-8052-4420-9043-773ca674717e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:35.848307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4b88f0e6-8052-4420-9043-773ca674717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:35.866298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 754/1542] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:35.868955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:35.869617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.869898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.870174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.870871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:35.871187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:35.872944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:35.879618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.879999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.880191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.912654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 789/1543] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:09:35.919952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:35.921345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:35.921883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:35.936154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 755/1544] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:09:35.937995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b010-6e56-4307-9e27-f565b0da0d0b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:35.941547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:35.948305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:35.948940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.949221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.949494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.950135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:35.951147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:35.951147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:09:35.951147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:09:35.951427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f462d-cb04-49ad-b77a-5576cd746499 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:35.952370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9950f5-2d7f-486a-ab5c-07bcb43cfcf5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:35.963790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:35.964450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.964730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.965005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:35.965662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:35.965970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:35.967145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:35.967145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:09:35.967145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:09:35.968179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6883686-5f18-4235-8f8b-6aa60753be7e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:35.990552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 756/1545] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:35.991918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:35.992227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:35.992502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.024580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.027941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.041805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 757/1546] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.042811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.059606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452c94-2868-4b88-abc8-81e6aa98f87f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.066925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.067833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.067833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.068223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.068796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.070760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.108264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 790/1547] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:35 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.109610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526b96-a59b-4bea-97eb-da9be7c7ca4d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.109900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526b96-a59b-4bea-97eb-da9be7c7ca4d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.110179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526b96-a59b-4bea-97eb-da9be7c7ca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.143522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9f526b96-a59b-4bea-97eb-da9be7c7ca4d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.144785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9f526b96-a59b-4bea-97eb-da9be7c7ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.211843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 791/1548] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.213273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4df6-c970-4e53-bf48-5b5141c0a693 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.213560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4df6-c970-4e53-bf48-5b5141c0a693 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.213896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4df6-c970-4e53-bf48-5b5141c0a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.233706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-747a4df6-c970-4e53-bf48-5b5141c0a693 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.234903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-747a4df6-c970-4e53-bf48-5b5141c0a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.245884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 758/1549] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.246061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 792/1550] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.246164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.246252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b28f-15cd-4f97-9a1a-1fc87a76b676 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.246252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b28f-15cd-4f97-9a1a-1fc87a76b676 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.246252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b28f-15cd-4f97-9a1a-1fc87a76b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.267032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f174b28f-15cd-4f97-9a1a-1fc87a76b676 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.269186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f174b28f-15cd-4f97-9a1a-1fc87a76b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.311248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce0076-2c7c-41d4-8fbf-41be87f873ef admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.315883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.316514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.316790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.317056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.317679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.318793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:36.318793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:09:36.318793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:09:36.320015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.330886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 793/1551] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.332167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a04d-23c7-45f6-adc3-16ccc79071d0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.332581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a04d-23c7-45f6-adc3-16ccc79071d0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.332866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a04d-23c7-45f6-adc3-16ccc79071d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.352167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7eb0a04d-23c7-45f6-adc3-16ccc79071d0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.353405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7eb0a04d-23c7-45f6-adc3-16ccc79071d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.361940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 794/1552] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.363089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a326-0a02-4d26-9695-4137bbaf7943 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.363375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a326-0a02-4d26-9695-4137bbaf7943 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.363656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a326-0a02-4d26-9695-4137bbaf7943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.383335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-94f6a326-0a02-4d26-9695-4137bbaf7943 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.384576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-94f6a326-0a02-4d26-9695-4137bbaf7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.392555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 795/1553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.400348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.400348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.400348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.400797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 759/1554] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.400797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.410287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b5e5-a5db-49c6-84e3-c595e6959ef7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.414845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.415443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.415727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.416031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.416705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.417001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.417551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.418643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8929b-c7a9-401f-a65e-0b9c74cf95e2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.418786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.427738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 796/1555] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.428528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.435478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 760/1556] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.438481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a608f-f885-4a1a-aeb0-7638c3e61c5b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.438867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2ed4-6d3f-48f8-aea7-242038d80c1d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.439154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2ed4-6d3f-48f8-aea7-242038d80c1d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.440043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2ed4-6d3f-48f8-aea7-242038d80c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.444011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.444929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.445217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.445492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.446112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.448001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.460814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7b1d2ed4-6d3f-48f8-aea7-242038d80c1d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.462019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7b1d2ed4-6d3f-48f8-aea7-242038d80c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.469839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 761/1557] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.471218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc591ee-4a6f-4e61-aa7a-6448bf230eab None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.471562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc591ee-4a6f-4e61-aa7a-6448bf230eab None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.471838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc591ee-4a6f-4e61-aa7a-6448bf230eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.491089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-edc591ee-4a6f-4e61-aa7a-6448bf230eab None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.492377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-edc591ee-4a6f-4e61-aa7a-6448bf230eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.500365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 762/1558] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.501450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1753e9-a6b0-4ee3-9566-58d6801580fc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.501741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1753e9-a6b0-4ee3-9566-58d6801580fc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.502753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1753e9-a6b0-4ee3-9566-58d6801580fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.522082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2d1753e9-a6b0-4ee3-9566-58d6801580fc None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.523223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2d1753e9-a6b0-4ee3-9566-58d6801580fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.530936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 763/1559] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.532108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706244b-32de-4613-b0c8-69805aba5576 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.532387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706244b-32de-4613-b0c8-69805aba5576 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.532706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706244b-32de-4613-b0c8-69805aba5576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.543937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 797/1560] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.543937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.552524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c1142-3489-4c6e-91fe-5b7752a020eb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.555602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5706244b-32de-4613-b0c8-69805aba5576 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.556827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5706244b-32de-4613-b0c8-69805aba5576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.557223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.557821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.558100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.558372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.559280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.560906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.562354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:36.565640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 764/1561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.566831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.567118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.567391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.577757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 798/1562] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:36.577757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.585669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc11-924d-4936-98ba-8c259bcb6c16 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.587300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:36.588548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:36.590556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.591971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.591971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.592434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.593436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.595633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.596328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 765/1563] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:36.597198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.606314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6fc07-b929-4edb-ada1-924723033483 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.610858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.613640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.613640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.613640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.613640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.613640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.615198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.627625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 766/1564] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.628449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.637833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2271c0-cc10-4f1c-a152-4523aeccf7ac admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.642291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.643741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.643741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.643741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.644059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.644366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.645927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.657404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 767/1565] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.658737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.667783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779627f9-92b1-402e-b1e1-2ae5eaed931b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.672301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.672857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.673397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.674269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.674888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.675199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.676744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.685621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 799/1566] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.686633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.689389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 768/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.689389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.700362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:36.704395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8014-7e07-4cff-9d94-b26114653ca4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.751220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a21c-06c4-4d3b-bf2d-62644660182b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.756264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.756877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.757161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.757438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.758103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.759706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.763861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.764541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.764825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.765386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.766055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.766385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.768101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.770087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 800/1568] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:36.770897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.779801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 769/1569] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.780292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9dbec-22f6-4af9-9c76-d6225299fa3e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.780810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.785774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.786380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.786653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.786929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.787566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.789183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.791739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1109480-982c-498a-8d37-6bd949c50e47 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.796580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.797176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.797456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.797728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.798687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:36.799537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.801086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 801/1570] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:36.801213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.801877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.811498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7756-21a7-4bfc-bc5f-25f5eb026c35 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.814282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 770/1571] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:36.815423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.818206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.819011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.819293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.819571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.820231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.822121 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.825856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97d10-366b-4da0-b466-6451ada46852 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:36.830821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:36.831414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:36.831697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:36.831996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:36.832633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:36.834523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:36.929541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 802/1572] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.930348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.958028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 771/1573] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:36.958028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:36.995681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829b7e2-dbb6-4813-bda0-4ee0e0df892a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.028123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90113655-23be-471b-af17-6fef4c218009 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.028445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.029081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.029366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.029637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.030267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.032212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.039649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:37.055685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.056328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.056606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.056874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.057549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.059600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.151789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 772/1574] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.152446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.164175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 803/1575] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:36 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.165044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.175382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a7f8b-2625-434b-ab52-2bfd846041f6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.201670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:37.216542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea077-f735-4629-bab5-29c9e1ffc10c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.222190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.222801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.223082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.223493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.224176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.225766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.231476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.232104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.232390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.232655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.233270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.235132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.235623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 773/1576] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:37.236468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.246725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6475f6-95ee-4b15-a0d1-c032c1450e11 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.252905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.253555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.253836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.254108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] PATH_INFO: `/v3/projects/128713a5eeb9484cbe290a88ea7a541e/users/21e9515113d04216823ea228e756175c/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.269486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128713a5eeb9484cbe290a88ea7a541e, user_id=21e9515113d04216823ea228e756175c, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.272191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.347048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 804/1577] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.348020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.374049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 774/1578] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:37 2022] PUT /identity/v3/projects/128713a5eeb9484cbe290a88ea7a541e/users/21e9515113d04216823ea228e756175c/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:37.375082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.416351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9c98-a84b-4734-8e77-3913a228ce8c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.440528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c1e5-150a-485e-b454-22ba3e613c26 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.445289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.445907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.446192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.446590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.447222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.449153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.472703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.476598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.476598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.476598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.476598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.476598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.488522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:37.556582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 775/1579] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.557397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.567126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fe9a-2c08-4cc4-a7bf-33cce7fe8929 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.571702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.572312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.572597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.572870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.573491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.575419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.618916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 805/1580] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/projects => generated 389 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.618916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.678325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55907268-7a7c-420b-97c7-fb72db186366 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.682923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.683520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.683799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.684100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.684723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.686617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.700034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 776/1581] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.701013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.711095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c52831-b4e1-4ac0-905e-df42221bfe64 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.715654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.716263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.716546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.716841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.717452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.719058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.730431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 777/1582] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:37.731950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.742169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43375978-8b2d-47ee-acb0-fdec781786cc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.746876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.747508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.747800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.748128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] PATH_INFO: `/v3/projects/58b8f9eaf2c6476187311cb688dd120d/users/55b45dd4422f458a8aa6467801a3f5ab/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.762597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b8f9eaf2c6476187311cb688dd120d, user_id=55b45dd4422f458a8aa6467801a3f5ab, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.765239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c84d7-8919-419f-8ab9-67ecad40ddb2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.780079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 806/1583] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.783806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.791836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd216dcc-0ec3-47fa-84ec-ba1c51961a1e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.796517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.797151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.797435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.797709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.798671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.800649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:37.837925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 778/1584] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:37 2022] PUT /identity/v3/projects/58b8f9eaf2c6476187311cb688dd120d/users/55b45dd4422f458a8aa6467801a3f5ab/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:37.839804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.840130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.840421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.867945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] MFA Rules not processed for user `21e9515113d04216823ea228e756175c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:37.869229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:37.906410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 807/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:37.907384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.918142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:37.918562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bcc95-aa72-4ddf-b5ae-a3a1ea8c50e6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:37.947080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 779/1586] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:37.947897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:37.987281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:37.987911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:37.988205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:37.988478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:37.989119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:37.990707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.000830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 808/1587] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.001544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.012929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173268-83f6-435e-9b76-4d07e78b34aa admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.018288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.019129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.019409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.019678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.020347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.021293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b5a0a-d069-4fde-9846-103e1a27354b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.021934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.026308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.026985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.027241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.027513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.028188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.030177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.032918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 809/1588] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.034671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.044435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ca3d-aa50-4e2b-8274-b7618958d9be admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.049426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.050035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.050311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.050581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.051195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.052839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.062517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 810/1589] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.063388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.072842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f28a1-5809-48a9-96f6-19836a0e1d40 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.077595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.078145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.078421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.078693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.079289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.081596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b9cb-2e17-470d-8691-19cc5d7189b1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.091104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 811/1590] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.092275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.092557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.097910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.120138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] MFA Rules not processed for user `55b45dd4422f458a8aa6467801a3f5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:38.121273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:38.133466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:38.152061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 780/1591] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:37 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:38.153078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.163759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b680d-ff9b-4352-9c64-9cadf2badec2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.168518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.169142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.169418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.169699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.170329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.171918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111995c-3d9c-4dce-b299-b179bee1381f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.182904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 781/1592] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.184144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b622-6d06-43c8-9a68-2d8d1ce5d8e3 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.184432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b622-6d06-43c8-9a68-2d8d1ce5d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.184706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b622-6d06-43c8-9a68-2d8d1ce5d8e3 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.185910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 782/1593] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 08:09:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:09:38.186605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b622-6d06-43c8-9a68-2d8d1ce5d8e3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.190174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 812/1594] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:38.200193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.201862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278ec78-7565-4b45-8e2b-ca1a385340b7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.201996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b622-6d06-43c8-9a68-2d8d1ce5d8e3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.207445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.208080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.208359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.208633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.208744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.209266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.209372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.209542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.209815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.210479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.210852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.212091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.224249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 813/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.224249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.227315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 783/1596] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.228346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.231865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e4d8b-e7ce-4e46-bb0b-d106b3e85847 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.236691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.237341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.237621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.237896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] PATH_INFO: `/v3/projects/c48430b16a2548b091217527e71301c9/users/a7ba1cd641544f61805a2ff5a10d20f2/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.238555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4dc77-90d6-4a5f-a419-f00639c58f4d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.243098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.243682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.243963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.244273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.244906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.246494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.253655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48430b16a2548b091217527e71301c9, user_id=a7ba1cd641544f61805a2ff5a10d20f2, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.254688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:38.254688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:09:38.254688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:09:38.256662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.257516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 784/1597] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.258293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.269111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e155-0fe8-4bd0-ba21-67284130aca0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.273772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.274367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.274653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.274928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.275564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.277197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.287708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 785/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.288662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.298734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91012349-5d40-4ab7-83e8-788abe86fec3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.303342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.303905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.304225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.304519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.305129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.306652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7467-3561-4692-a934-98fe68fe9157 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.318307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 786/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.319502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.319789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.320091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.326131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 814/1600] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:38 2022] PUT /identity/v3/projects/c48430b16a2548b091217527e71301c9/users/a7ba1cd641544f61805a2ff5a10d20f2/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:38.326933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.358698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:38.359946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:38.398715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a418-9dcf-4799-971e-e3fd20722d19 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.403782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.404655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.405099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.405369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.405992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.407860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.416229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:38.428328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 787/1601] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:38.429163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.438987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c647e9-e4d1-432d-b687-7279ba8e6dd7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.444763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.445392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.445703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.445994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] PATH_INFO: `/v3/projects/365f12f5f53f4618aedc9c9a6b373ebe/users/7024eea9fd7a4859b305e9f7258b9e46/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.461965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365f12f5f53f4618aedc9c9a6b373ebe, user_id=7024eea9fd7a4859b305e9f7258b9e46, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.464663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.542927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 815/1602] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:38 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:38.543857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.570677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 788/1603] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:38 2022] PUT /identity/v3/projects/365f12f5f53f4618aedc9c9a6b373ebe/users/7024eea9fd7a4859b305e9f7258b9e46/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:38.571530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.608797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdeaa9-76e5-4ffe-a397-7aa383ea1eb2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.618490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:38.637190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fdae-7b72-472c-9516-022640ce4a88 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.641916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.642659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.643175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.643457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] PATH_INFO: `/v3/projects/0aff4b86f361482e9b072cd1a3e8ff46/users/fa693691cac940b6a07cbdde5e68c65c/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.658060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aff4b86f361482e9b072cd1a3e8ff46, user_id=fa693691cac940b6a07cbdde5e68c65c, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.661120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.668161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.668827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.669098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.669367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] PATH_INFO: `/v3/projects/ab889e0f5d354c2a93ded904ef10ac1f/users/8eeb6e15b5f4436380419253c79a58fd/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.684778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab889e0f5d354c2a93ded904ef10ac1f, user_id=8eeb6e15b5f4436380419253c79a58fd, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.687425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.740204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 789/1604] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:38 2022] PUT /identity/v3/projects/0aff4b86f361482e9b072cd1a3e8ff46/users/fa693691cac940b6a07cbdde5e68c65c/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:38.741118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.770269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 816/1605] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:38 2022] PUT /identity/v3/projects/ab889e0f5d354c2a93ded904ef10ac1f/users/8eeb6e15b5f4436380419253c79a58fd/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:38.771449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.809957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a74d0-8d9a-4a27-8808-54e3f4db9713 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.834743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f290-a186-430b-940b-8754d42624c6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:38.840245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.841144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.841424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.841811 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] PATH_INFO: `/v3/projects/af5df9ae2f0643e6b1660649814f1135/users/90304d533deb4ab99b62147d898314eb/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.858314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5df9ae2f0643e6b1660649814f1135, user_id=90304d533deb4ab99b62147d898314eb, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.860996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.868509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:38.869128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.869417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.869695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.870342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:38.872015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1cfd0-45ea-4653-83e0-1901ff46c251 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:38.877453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:38.882850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 790/1606] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:38.884075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:38.884474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:38.884749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:38.912427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] MFA Rules not processed for user `a7ba1cd641544f61805a2ff5a10d20f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:38.913560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:38.951593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 817/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:38 2022] PUT /identity/v3/projects/af5df9ae2f0643e6b1660649814f1135/users/90304d533deb4ab99b62147d898314eb/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:38.952738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.977549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 791/1608] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:38.978775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:38.989469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf875a-bc99-4728-991f-a7c1e5f7182a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.029878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8a5b8-ff5e-4176-b3bd-5c76b56d54c6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.037720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.037720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.038180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.038180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.049400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.050470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.050758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.051190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.051855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.053842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:39.060678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570133f5-f7d2-4972-ad58-71726adcdfda admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.097852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.099524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20382cfa-0554-4554-b92f-6047bcbdde21 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.108566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 818/1609] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.109961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8b9a-35f2-4397-b502-8074e71323b0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.110265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8b9a-35f2-4397-b502-8074e71323b0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.110525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8b9a-35f2-4397-b502-8074e71323b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.129595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-714a8b9a-35f2-4397-b502-8074e71323b0 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.130790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-714a8b9a-35f2-4397-b502-8074e71323b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.138081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 792/1610] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:38 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:39.138081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.138081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.138081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.145321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 819/1611] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.145321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4c65-5790-4949-9e3d-2524a737965d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.145321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4c65-5790-4949-9e3d-2524a737965d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.145321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4c65-5790-4949-9e3d-2524a737965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.164737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bdff4c65-5790-4949-9e3d-2524a737965d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.164929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.165859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bdff4c65-5790-4949-9e3d-2524a737965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.165977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.174262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 793/1612] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.174383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 820/1613] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.175684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7adf-f6ae-4477-9193-8330ec4922f3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.176008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7adf-f6ae-4477-9193-8330ec4922f3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.176278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7adf-f6ae-4477-9193-8330ec4922f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.181133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.193639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44632fb-a120-4daa-ab62-a52ba88e9d7f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.196761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5dec7adf-f6ae-4477-9193-8330ec4922f3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.202025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5dec7adf-f6ae-4477-9193-8330ec4922f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.202187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.202187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.202187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.202187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] PATH_INFO: `/v3/projects/ea799e24da9f41f08abd32cc0b6a91d0/users/91c021bd2d524d16b5b3f11a2dab8b56/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.211269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 821/1614] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.211269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f014-8385-49a2-afd9-857cd79fda40 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.211269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f014-8385-49a2-afd9-857cd79fda40 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.211269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f014-8385-49a2-afd9-857cd79fda40 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.212009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 822/1615] 10.222.0.43 () {54 vars in 962 bytes} [Tue Sep 13 08:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:09:39.212563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7f014-8385-49a2-afd9-857cd79fda40 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.219510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea799e24da9f41f08abd32cc0b6a91d0, user_id=91c021bd2d524d16b5b3f11a2dab8b56, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.222698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.226502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7f014-8385-49a2-afd9-857cd79fda40 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.231035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.231630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.231912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.232217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.232852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.234464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.247330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 823/1616] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:39.247330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.304060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5baf-3806-4f7a-a640-63dc8c66b678 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.308429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.309216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.309581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.309995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.320535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.322182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.334037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 824/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.335364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.347894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 794/1618] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:39 2022] PUT /identity/v3/projects/ea799e24da9f41f08abd32cc0b6a91d0/users/91c021bd2d524d16b5b3f11a2dab8b56/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:39.348688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233097-9ba8-46e1-bc3a-c9a915693ae5 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.349968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.407014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.407622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.407921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.408439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.410660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:39.414388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540d10-0c6e-433d-ab04-e7973d8b7092 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.418136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.418670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.418953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.419228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.470014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:39.474467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.474467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e8ee-7724-44b7-8f2c-7dbbdd7b84e6 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.482278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.483749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.486774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 825/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.488540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78753-9d0c-4e55-83fa-a5e7cd1047f6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.488828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78753-9d0c-4e55-83fa-a5e7cd1047f6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.489109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78753-9d0c-4e55-83fa-a5e7cd1047f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.495721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 795/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.496661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.505290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c507-6b85-424e-909b-d41e04b9509e service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.509147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.509761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.510037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.510307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.510601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-afb78753-9d0c-4e55-83fa-a5e7cd1047f6 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.512544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-afb78753-9d0c-4e55-83fa-a5e7cd1047f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.523684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.525961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.541222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 796/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.542409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.552464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0716e-6eae-4407-aab1-ac4c5675a3b5 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.557633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.558292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.558594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.558867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] PATH_INFO: `/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376/users/04adbe12a037455dac389dc91e3d6bfb/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.575151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d8dd1ead774d9d9ba2e400b7360376, user_id=04adbe12a037455dac389dc91e3d6bfb, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.577932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b8e36-5fd3-45b8-bcc4-79bd0740e328 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.592541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 826/1622] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.593906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0216e4-834e-42b2-9525-9a92108fcab2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.594288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0216e4-834e-42b2-9525-9a92108fcab2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.594659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0216e4-834e-42b2-9525-9a92108fcab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.613869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7a0216e4-834e-42b2-9525-9a92108fcab2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.615056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7a0216e4-834e-42b2-9525-9a92108fcab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.622661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 827/1623] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.623824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff900a-26ca-4bdc-854c-475ffb78d9b7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.624295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff900a-26ca-4bdc-854c-475ffb78d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.625294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff900a-26ca-4bdc-854c-475ffb78d9b7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.626685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 828/1624] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 08:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:09:39.629193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff900a-26ca-4bdc-854c-475ffb78d9b7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.648758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff900a-26ca-4bdc-854c-475ffb78d9b7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.654334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.654931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.655209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.655480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.671344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 797/1625] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:39 2022] PUT /identity/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376/users/04adbe12a037455dac389dc91e3d6bfb/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:39.671344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.671344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.671344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.699108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:39.707050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:39.761686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.764496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.778399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 829/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.780032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.786401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 798/1627] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:39.787124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.792628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073b46-ed04-48af-8e6a-34154d9d35ce service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.859300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:39.868640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.869448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.869828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.870521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.871644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a27e-1152-419b-978b-9807efaeff24 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.876428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.877581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.877862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.878131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.878773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.880419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.885458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.885951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.894815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 799/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:39.895925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.899667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 830/1629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:39.900683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:39.911237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:39.916355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a258-9114-48a4-add2-f2c63e661f5e service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.922280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:39.923445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.924017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.924363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] PATH_INFO: `/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376/users/04adbe12a037455dac389dc91e3d6bfb/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:39.927085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d8dd1ead774d9d9ba2e400b7360376, user_id=04adbe12a037455dac389dc91e3d6bfb, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:39.930517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb834d-7d5e-4b80-9347-96fd3f24ed5c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:39.959116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 831/1630] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:39 2022] PUT /identity/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376/users/04adbe12a037455dac389dc91e3d6bfb/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:39.965055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14af6-dfbb-40c7-bcab-33d1733410ac admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:39.973211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddacf-f75d-462b-b54f-5b6649c1535e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:39.973211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddacf-f75d-462b-b54f-5b6649c1535e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:39.973211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddacf-f75d-462b-b54f-5b6649c1535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:40.023435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-92eddacf-f75d-462b-b54f-5b6649c1535e None None] MFA Rules not processed for user `04adbe12a037455dac389dc91e3d6bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:40.024916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-92eddacf-f75d-462b-b54f-5b6649c1535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:40.042918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:40.044083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:40.044411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:40.044684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:40.251213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 832/1631] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:40.255538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573564a-8e26-4400-87b3-895e1858f919 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:40.255538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573564a-8e26-4400-87b3-895e1858f919 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:40.255538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573564a-8e26-4400-87b3-895e1858f919 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:40.255538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 833/1632] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 08:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:09:40.257479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:40.258948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5a2b8-8890-4590-8976-0574e155c2b4 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:40.264482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573564a-8e26-4400-87b3-895e1858f919 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:40.289992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573564a-8e26-4400-87b3-895e1858f919 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:40.296565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:40.297063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:40.297359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:40.297653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:40.297781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 800/1633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:40.300711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:40.300948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:40.301227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:40.336933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:40.338234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:40.350808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 801/1634] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:40.381055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:40.382504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:40.396194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 834/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:41.431428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:41.452855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f52f6-9d68-424f-b8cf-233d701a5b0c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:41.459254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:41.460123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:41.460478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:41.460897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:41.498032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:41.518648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4bf2f-aadd-4634-a41d-7267443ecb30 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:41.891683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 802/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:41.901618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:41.987775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3306-a09f-4014-be13-4c1d184111e5 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:41.994224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:41.994888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:41.995225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:41.995556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] PATH_INFO: `/v3/users/a7ba1cd641544f61805a2ff5a10d20f2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:41.996873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ba1cd641544f61805a2ff5a10d20f2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:41.997954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: WARNING py.warnings [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:41.997954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: warnings.warn(msg) Sep 13 08:09:41.997954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: Sep 13 08:09:41.999385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:42.040507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:42.244681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ba1cd641544f61805a2ff5a10d20f2'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:42.274302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ba1cd641544f61805a2ff5a10d20f2'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:42.290918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ba1cd641544f61805a2ff5a10d20f2'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:42.408258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ba1cd641544f61805a2ff5a10d20f2'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:42.408973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ba1cd641544f61805a2ff5a10d20f2'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:42.416778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 835/1637] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:09:41 2022] DELETE /identity/v3/users/a7ba1cd641544f61805a2ff5a10d20f2 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:42.421441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:42.421886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:42.422170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:42.445690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:42.446819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:42.494439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:42.563193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 803/1638] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:42.634027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:42.636479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:42.719019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49f1cf-c037-480b-ade8-094c926d7697 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:42.723850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:42.725163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:42.725163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:42.725471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:42.740342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:42.742261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:42.757640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 836/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:09:44.583128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:44.585849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:44.616360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734121b-6ba8-44c0-8cc7-8ac17f4e1510 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:44.653764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:44.653764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:44.653764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:44.653764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] PATH_INFO: `/v3/users/21e9515113d04216823ea228e756175c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:44.666762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e9515113d04216823ea228e756175c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:44.677366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:45.207320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:45.210323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:45.261004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505071-cb95-459c-8cbf-3a1bbe4405eb service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:45.301506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:45.302856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:45.303530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:45.304508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] PATH_INFO: `/v3/projects/c48430b16a2548b091217527e71301c9` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:45.310642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48430b16a2548b091217527e71301c9)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:45.317218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:45.317765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e9515113d04216823ea228e756175c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.347903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e9515113d04216823ea228e756175c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.365937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e9515113d04216823ea228e756175c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.382873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e9515113d04216823ea228e756175c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.500205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48430b16a2548b091217527e71301c9', 'request_id': 'req-c82b12a1-7e65-4688-9ab0-6e759064bd79'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.518481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48430b16a2548b091217527e71301c9', 'request_id': 'req-c82b12a1-7e65-4688-9ab0-6e759064bd79'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.529595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fecb298b-cd5b-45ea-8e8e-e87de52ddc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e9515113d04216823ea228e756175c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.531040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48430b16a2548b091217527e71301c9', 'request_id': 'req-c82b12a1-7e65-4688-9ab0-6e759064bd79'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.540334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 804/1640] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:09:44 2022] DELETE /identity/v3/users/21e9515113d04216823ea228e756175c => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:45.545225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:45.545586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:45.545943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:45.630947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:45.680705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:45.682535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] The token cache is being invalidate because project c48430b16a2548b091217527e71301c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:09:45.682840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.684462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c82b12a1-7e65-4688-9ab0-6e759064bd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:45.686744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 837/1641] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:09:45 2022] DELETE /identity/v3/projects/c48430b16a2548b091217527e71301c9 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:09:45.695074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3723f-355e-413d-991e-b2df9e0aa12c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:45.700241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3723f-355e-413d-991e-b2df9e0aa12c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:45.700620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3723f-355e-413d-991e-b2df9e0aa12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:45.766742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ddd3723f-355e-413d-991e-b2df9e0aa12c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:45.773036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ddd3723f-355e-413d-991e-b2df9e0aa12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:45.833345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:45.926977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 805/1642] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:45.999341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.003270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:46.075802 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 838/1643] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:46.077406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.077699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.078564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.117144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:46.118428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:46.139219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 839/1644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:46.149018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.150555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:46.170039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3fea4-be86-4ce5-b725-02a0862458d7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.190249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.191058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.191170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.191659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.205940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:46.205940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.211418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00105-c9fe-41d8-af44-8d76d432fb0c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.220078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.225343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.225820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.226006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.226276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.253116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 840/1645] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:46.254484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.255913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.257423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.306231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 806/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:46.310118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c882eb9-afbf-4850-92fc-251965ed81f5 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.317872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.318507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.318789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.319067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.319716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.321923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.449667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 841/1647] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:46 2022] POST /identity/v3/projects => generated 405 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:46.450165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.470020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc3ac-5bbc-4cf2-a303-2e3309462878 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.633027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.633733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.633932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.634482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.635132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.637155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.773148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 807/1648] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:46 2022] POST /identity/v3/users => generated 303 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:09:46.775810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.797401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c6e6-6b64-42f1-8d66-a457c51aa8cf admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.822092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.823057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.823352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.823633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.824314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.832881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.862813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 842/1649] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:46.864112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.882449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58805-7dd8-4da1-bb31-2245f05bda9f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.898506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.898737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.899020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.899317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:46.900640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:46.902280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:46.934397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 808/1650] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:46.945524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:46.968353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaace2-8aac-4a3e-b4cd-c13a788b1b10 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:46.990205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:46.991205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:46.996277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:46.996785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] PATH_INFO: `/v3/projects/94ad779db32746a2ab72a23e2702bf88/users/501b8ff8635d46118511751433f74b32/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:47.065615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ad779db32746a2ab72a23e2702bf88, user_id=501b8ff8635d46118511751433f74b32, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:47.071783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc92b-50ec-477f-9523-055859aefd88 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:47.121545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:47.124409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:47.188326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 843/1651] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:46 2022] PUT /identity/v3/projects/94ad779db32746a2ab72a23e2702bf88/users/501b8ff8635d46118511751433f74b32/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:47.194060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:47.194349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:47.194685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:47.287877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:47.289763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:47.290144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95796f0-1566-4752-96c3-b5823a8efdf3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:47.482730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:47.483467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:47.489537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:47.489921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:47.490949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 844/1652] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:09:47.493810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:47.536981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:47.564955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:47.566406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:47.615663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:47.619354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:47.645786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 809/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:47.675644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:47.692993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cce4cd-681d-4608-b1c7-7a5b50962d6e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:47.699526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:47.700415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:47.702780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:47.702780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:47.712489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:47.714471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bfa98-d5a6-4ff2-abc7-27ec80ae8b77 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:47.729839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 845/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:48.719739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:48.723299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:48.739018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba64ad-5166-44ba-b57e-5ffa756e6fe6 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:48.745146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:48.746156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:48.746642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:48.747123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] PATH_INFO: `/v3/projects/128713a5eeb9484cbe290a88ea7a541e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:48.748577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=128713a5eeb9484cbe290a88ea7a541e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:48.750318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: WARNING py.warnings [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 08:09:48.750318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: warnings.warn(msg) Sep 13 08:09:48.750318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: Sep 13 08:09:48.752298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:48.969737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128713a5eeb9484cbe290a88ea7a541e', 'request_id': 'req-fb494d49-d927-4765-8a75-fd6e9c2fb41a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:49.057280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128713a5eeb9484cbe290a88ea7a541e', 'request_id': 'req-fb494d49-d927-4765-8a75-fd6e9c2fb41a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:49.082479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128713a5eeb9484cbe290a88ea7a541e', 'request_id': 'req-fb494d49-d927-4765-8a75-fd6e9c2fb41a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:49.105618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] The token cache is being invalidate because project 128713a5eeb9484cbe290a88ea7a541e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:09:49.106265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:49.107811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-fb494d49-d927-4765-8a75-fd6e9c2fb41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:09:49.110215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 810/1655] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:09:48 2022] DELETE /identity/v3/projects/128713a5eeb9484cbe290a88ea7a541e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:49.116241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.116774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.117040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.153029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:49.154276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:49.331746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.332482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.332924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.334922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 846/1656] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:49.401416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:49.403408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:49.422085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 811/1657] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:09:49.427195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:49.440101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7426e1-c4c2-4a9f-992a-16d419e95e21 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:49.446062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:49.446820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.447108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.447384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.448539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:09:49.448848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:49.450487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:49.469397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 847/1658] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:09:49.472068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:49.483676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30035b0-c08c-4a8d-a0dd-f0699d43e3c5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:49.489817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:49.494378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.494378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.494378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.494378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:49.494378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:49.643378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 812/1659] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:49 2022] POST /identity/v3/projects => generated 355 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:49.647245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:49.660361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a53a-8482-405f-ac83-f953965d8b2b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:49.756213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:49.757357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.757357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.757570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.771574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:49.776531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:49.891960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 848/1660] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:49 2022] POST /identity/v3/users => generated 278 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:09:49.897697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:49.918955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f2a1-5af2-4413-a148-ac42131ca9a1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:49.932112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:49.933244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:49.933672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:49.934257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:49.935334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:49.940563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:49.983730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 813/1661] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:49.988956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:50.010269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283d53-9e81-4684-a0d0-9fb3078f4d85 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:50.025350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:50.025350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.025350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.025350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:50.025779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:50.027563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc124ef-2392-44d5-9b8c-b41522ad8698 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:50.069761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 849/1662] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:50.071662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:50.090765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86894d8e-1f19-4ebd-9d91-795d1c8038a4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:50.110358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:50.111800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.112270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.112739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] PATH_INFO: `/v3/projects/1d5ff6b06a8945768feabaea3b128d3f/users/4c9db03e1362446c8c04aecee5235a33/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:50.150109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5ff6b06a8945768feabaea3b128d3f, user_id=4c9db03e1362446c8c04aecee5235a33, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:50.153190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:50.260317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 814/1663] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:50 2022] PUT /identity/v3/projects/1d5ff6b06a8945768feabaea3b128d3f/users/4c9db03e1362446c8c04aecee5235a33/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:50.276112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae2de-3036-4850-b6f8-3a48d90bd979 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.276583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae2de-3036-4850-b6f8-3a48d90bd979 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.276882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae2de-3036-4850-b6f8-3a48d90bd979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:50.332966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f34ae2de-3036-4850-b6f8-3a48d90bd979 None None] MFA Rules not processed for user `4c9db03e1362446c8c04aecee5235a33`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:50.334380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f34ae2de-3036-4850-b6f8-3a48d90bd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:50.421509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:50.476063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 850/1664] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:50.482934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:50.584515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:50.600872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.600872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.600872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:50.628448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364b25-1c1c-4236-b286-b5d87f635dbf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:50.643728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:50.645052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.645342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.645621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:50.646283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:50.648548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] MFA Rules not processed for user `90304d533deb4ab99b62147d898314eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:50.649822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:50.651806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:50.802975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 815/1665] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:50 2022] POST /identity/v3/projects => generated 357 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:50.807590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:50.847067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 851/1666] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:09:50.862091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:50.863522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:50.978541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69679bcf-f12e-4a14-88d7-a58006c8a29f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:50.990203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:50.990844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:50.992157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:50.994022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.002869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.005296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.022813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9c47b-1f59-4d2e-88c7-907a55afb0a2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.111949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 816/1667] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:50 2022] POST /identity/v3/users => generated 285 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:51.116019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.147109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1f556-cdf1-4b3f-b135-997b329e9648 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.148607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.149235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.149518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.149787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.150432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.152067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.170354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 817/1668] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:09:51.177968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.182247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.182885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.183172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.183448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.202162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb724b-1004-45ea-9153-c8f862ecc89f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.213697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.215315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.215794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.217050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] PATH_INFO: `/v3/projects/c014f2e8548940509ef0654953e4915a/users/1aa7cae8b7d646c08ecb1fa085977eb5/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.258411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c014f2e8548940509ef0654953e4915a, user_id=1aa7cae8b7d646c08ecb1fa085977eb5, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.268490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.297742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.301410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76a35-e287-400a-91f7-fa0b1cd6db86 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.314575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 852/1669] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:51.316540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.316842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.317387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.363962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 818/1670] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:51 2022] PUT /identity/v3/projects/c014f2e8548940509ef0654953e4915a/users/1aa7cae8b7d646c08ecb1fa085977eb5/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:51.367312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.385963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] MFA Rules not processed for user `501b8ff8635d46118511751433f74b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:51.387654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:51.426443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:51.528785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077e9f3-7841-4235-9419-819bfbc0ff44 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.555560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 853/1671] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:51.555886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.556705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.556998 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.557281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.557946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.559794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.560193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.561916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:51.578804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 819/1672] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:51.582670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.584081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487ef9-1d37-4d86-91e9-3c24e97e8bdc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.589363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.590047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.590393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.590847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.591723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.592343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221e11-9975-4c54-9aaa-c981e9e5c9da admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.593891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.617345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.618253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.618547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.618828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] PATH_INFO: `/v3/projects/c014f2e8548940509ef0654953e4915a/users/1aa7cae8b7d646c08ecb1fa085977eb5/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.628777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c014f2e8548940509ef0654953e4915a, user_id=1aa7cae8b7d646c08ecb1fa085977eb5, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.634629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ecfbf-79b6-41fe-8176-7460c0d255ce admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.672727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 820/1673] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:51 2022] PUT /identity/v3/projects/c014f2e8548940509ef0654953e4915a/users/1aa7cae8b7d646c08ecb1fa085977eb5/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:51.688592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.691527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.692467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.746399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 854/1674] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:09:51 2022] POST /identity/v3/projects => generated 405 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:09:51.747494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.786675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] MFA Rules not processed for user `1aa7cae8b7d646c08ecb1fa085977eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:51.790771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:51.859191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6024eb-d201-483b-ba3b-77878dacd142 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:51.865969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:51.866683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:51.867033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:51.867414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:51.868169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:51.871275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:51.938195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 821/1675] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:51.946233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.953225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:51.976312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 855/1676] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:09:51 2022] POST /identity/v3/users => generated 309 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:09:51.979493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:51.997865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cf33-6cd6-4893-8544-7fde0f5e7a16 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.014172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.014650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.014923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.015194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.017662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.025015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.063746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 856/1677] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:52.066273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:52.094117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa69f0-eb65-45eb-9634-b044429d32f4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.098288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff649f-59d2-4cf8-891d-68b79019cded None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.103488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:52.106994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.110049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.111604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.112806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.113828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.114638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.114994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.122088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] PATH_INFO: `/v3/projects/229938df9c2b4e37999575d33d953320/users/6704e51951e94d4eb4d126e158ad5362/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.140538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.145025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.155485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=229938df9c2b4e37999575d33d953320, user_id=6704e51951e94d4eb4d126e158ad5362, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.159076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.171600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 822/1678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:52.287220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 857/1679] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:52 2022] PUT /identity/v3/projects/229938df9c2b4e37999575d33d953320/users/6704e51951e94d4eb4d126e158ad5362/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:52.288645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:52.313309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25b03a-056a-46b1-8007-dda8ebec5a98 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.430847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.431670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.432210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.432598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.433565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.435697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.451881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 823/1680] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:09:52.452918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:52.467140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911792fe-005f-4445-9f4d-ac836a2113ba admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.478277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.480611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.481320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.482466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] PATH_INFO: `/v3/projects/229938df9c2b4e37999575d33d953320/users/6704e51951e94d4eb4d126e158ad5362/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.489363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229938df9c2b4e37999575d33d953320, user_id=6704e51951e94d4eb4d126e158ad5362, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.496789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126e893-bf3d-4047-bad9-ce53d64a1750 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.514278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:52.518001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:52.522490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 858/1681] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:09:52 2022] PUT /identity/v3/projects/229938df9c2b4e37999575d33d953320/users/6704e51951e94d4eb4d126e158ad5362/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:09:52.611780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbac3-c9b3-4bc0-b4d8-cb48f163ec0e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:52.674249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:52.686362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:52.687358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:52.687885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:52.688399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:52.794662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:52.797721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63165471-f0b7-461b-b4f2-0af86f83739e service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:52.810993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 824/1682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:54.088662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:56.977240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf66f5-b311-4822-acef-9266720715ce None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:56.978264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf66f5-b311-4822-acef-9266720715ce None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:56.978732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf66f5-b311-4822-acef-9266720715ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:57.043303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-44bf66f5-b311-4822-acef-9266720715ce None None] MFA Rules not processed for user `6704e51951e94d4eb4d126e158ad5362`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:57.046812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-44bf66f5-b311-4822-acef-9266720715ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:57.273201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 859/1683] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:57.730979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f3ea-a474-4453-9b54-c94411ea7b3a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:57.731447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f3ea-a474-4453-9b54-c94411ea7b3a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:57.731718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f3ea-a474-4453-9b54-c94411ea7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:57.803231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6443f3ea-a474-4453-9b54-c94411ea7b3a None None] MFA Rules not processed for user `7024eea9fd7a4859b305e9f7258b9e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:57.812863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6443f3ea-a474-4453-9b54-c94411ea7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:58.000191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 825/1684] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:58.021983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf66f5-b311-4822-acef-9266720715ce None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:58.024465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-44bf66f5-b311-4822-acef-9266720715ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:58.250450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf66f5-b311-4822-acef-9266720715ce None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:58.264663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:58.265089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:58.265365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:58.265637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:58.289598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:58.298944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53adc5-e593-4f5c-9afa-1dee668ee3d3 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:58.331925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 860/1685] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:58.530051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:58.530249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:58.530492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:58.600656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] MFA Rules not processed for user `fa693691cac940b6a07cbdde5e68c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:58.601955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:58.665754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:58.844671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 826/1686] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:58.854937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055a2b2-a6b5-4d20-90d3-6fa98989a523 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:58.855262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055a2b2-a6b5-4d20-90d3-6fa98989a523 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:58.855541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055a2b2-a6b5-4d20-90d3-6fa98989a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:58.900601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7055a2b2-a6b5-4d20-90d3-6fa98989a523 None None] MFA Rules not processed for user `fa693691cac940b6a07cbdde5e68c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:58.908567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7055a2b2-a6b5-4d20-90d3-6fa98989a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:58.940419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 861/1687] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:58.952425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:09:58.981468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65b604-7ca6-4ee2-889c-90f487425364 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:09:58.995019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:09:58.995019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:58.995019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:58.995019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:59.018119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:09:59.023852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369ec51-3a77-4171-b215-dda2a2009734 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:09:59.050344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 827/1688] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:09:59.227488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518791-5133-4875-949b-ff4b2fb889d9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:59.230333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518791-5133-4875-949b-ff4b2fb889d9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:59.230333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518791-5133-4875-949b-ff4b2fb889d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:59.318478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7c518791-5133-4875-949b-ff4b2fb889d9 None None] MFA Rules not processed for user `90304d533deb4ab99b62147d898314eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:09:59.320119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7c518791-5133-4875-949b-ff4b2fb889d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:09:59.378778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:59.490443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 862/1689] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:09:59.919718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b66d-be50-447b-8014-00996681424e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:59.920294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b66d-be50-447b-8014-00996681424e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:59.920753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b66d-be50-447b-8014-00996681424e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:09:59.924990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 828/1690] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:09:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:09:59.981732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:09:59.982277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:09:59.982708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.026915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:00.030310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.164674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cf7-75d7-42e4-9c20-5f0f29ce5b44 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.165216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cf7-75d7-42e4-9c20-5f0f29ce5b44 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.165639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f869cf7-75d7-42e4-9c20-5f0f29ce5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.225036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 863/1691] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:00.246419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1f869cf7-75d7-42e4-9c20-5f0f29ce5b44 None None] MFA Rules not processed for user `8eeb6e15b5f4436380419253c79a58fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:00.247850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f869cf7-75d7-42e4-9c20-5f0f29ce5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.286084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:00.287795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.308164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121d7ee-1023-46c4-aa5e-fbfbc057381e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:00.323509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:00.324256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.324622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.325021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.358382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:00.369501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd715-ef3f-4f46-ab9e-43d19a6be182 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:00.386612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 829/1692] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:00.415593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 864/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:00.424652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.424652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.424652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.437889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa74f-0331-447b-8c25-936e7d434963 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.438260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa74f-0331-447b-8c25-936e7d434963 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.438732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaa74f-0331-447b-8c25-936e7d434963 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.440316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 865/1694] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 08:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:10:00.445896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576711-260f-49f7-b9aa-fa865430b954 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.446272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576711-260f-49f7-b9aa-fa865430b954 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.446847 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576711-260f-49f7-b9aa-fa865430b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.460718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] MFA Rules not processed for user `8eeb6e15b5f4436380419253c79a58fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:00.462258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.474190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 830/1695] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:00.551129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-79576711-260f-49f7-b9aa-fa865430b954 None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:00.553357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-79576711-260f-49f7-b9aa-fa865430b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.750264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 866/1696] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:10:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 08:10:00.820553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:00.822856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:00.866941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e8f8-7bc6-4227-8272-8f0c62f672ea None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:00.886085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:00.901453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:00.901794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:00.902092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:00.926876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:00.926876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02592-1484-469a-a768-0112d63dfa98 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:00.940588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 831/1697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:01.251952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:01.251952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:01.251952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:01.253884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 867/1698] 10.222.0.43 () {54 vars in 912 bytes} [Tue Sep 13 08:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:10:01.273926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:01.274478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:01.275195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:01.320868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:01.322339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:01.340417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 832/1699] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:10:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:01.423646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:01.435812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:01.463432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e0e2-98fc-406f-8d79-04d35ff0e972 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:01.471094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:01.471880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:01.472441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:01.472870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:01.497440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:01.499130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:01.529285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 868/1700] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:01.962392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:01.984646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbae6a-dfdf-4857-aec1-562976cd53cf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:02.011119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:02.012331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.012871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.013506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.034338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:02.037738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401273b0-5353-4e76-8a3e-3252d3407277 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:02.078727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 833/1701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:02.114240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:02.141237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db5d17-3ddf-4eac-95f8-7126cb38ea36 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:02.156400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:02.160285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.160752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.161628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.167397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:02.200379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:02.202845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef917bd-fbd6-48b1-9f33-c86585b3b7c3 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:02.226007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 869/1702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:02.236595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074d23-e342-40cd-ae50-71d9ce836b53 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.236595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074d23-e342-40cd-ae50-71d9ce836b53 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.236595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074d23-e342-40cd-ae50-71d9ce836b53 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.239428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 834/1703] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:10:02.281104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d374-f85f-4af5-9ea0-e8f67f3407f1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.281584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d374-f85f-4af5-9ea0-e8f67f3407f1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.282042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d374-f85f-4af5-9ea0-e8f67f3407f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.321703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6371d374-f85f-4af5-9ea0-e8f67f3407f1 None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:02.323082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6371d374-f85f-4af5-9ea0-e8f67f3407f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:02.348058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 870/1704] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:10:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:02.378821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392494-ece5-433b-9dbe-055c51c6fc9e None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.379350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392494-ece5-433b-9dbe-055c51c6fc9e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.379829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d392494-ece5-433b-9dbe-055c51c6fc9e None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.381442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 835/1705] 10.222.0.43 () {54 vars in 961 bytes} [Tue Sep 13 08:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:10:02.387252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.387843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.388430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.425827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] MFA Rules not processed for user `924118f361c54787b3eb164a7789137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:02.431255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:02.476584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d392494-ece5-433b-9dbe-055c51c6fc9e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:02.481048 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 871/1706] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Sep 13 08:10:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:02.504577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d392494-ece5-433b-9dbe-055c51c6fc9e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:02.525847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:02.526596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.527633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.528105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.616490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:02.622217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc275af5-bc48-4c4c-a914-fd5a49953334 service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:02.652681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:02.659408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:02.695167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 836/1707] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:02.875690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1812-2d99-4e49-9865-0dccba87a204 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:02.898837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b15e3-0e03-4395-b72c-31ebc61f45ed None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.899393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b15e3-0e03-4395-b72c-31ebc61f45ed None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.899861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b15e3-0e03-4395-b72c-31ebc61f45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.956294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:02.959334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:02.960143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:02.961804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] PATH_INFO: `/v3/users/501b8ff8635d46118511751433f74b32` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:02.964288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=501b8ff8635d46118511751433f74b32)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:02.971309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:03.067187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0c5b15e3-0e03-4395-b72c-31ebc61f45ed None None] MFA Rules not processed for user `91c021bd2d524d16b5b3f11a2dab8b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:03.068481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0c5b15e3-0e03-4395-b72c-31ebc61f45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:03.244965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:03.297254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501b8ff8635d46118511751433f74b32'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:03.340534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501b8ff8635d46118511751433f74b32'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:03.365421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501b8ff8635d46118511751433f74b32'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:03.385822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 837/1708] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:03.464693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501b8ff8635d46118511751433f74b32'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:03.469438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501b8ff8635d46118511751433f74b32'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:03.483030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:03.483529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:03.483886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:03.505964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 872/1709] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:02 2022] DELETE /identity/v3/users/501b8ff8635d46118511751433f74b32 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:03.550595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] MFA Rules not processed for user `fa693691cac940b6a07cbdde5e68c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:03.553966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:03.768718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 838/1710] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:03.905595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:03.907949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:04.035215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42312027-4a49-4745-ba15-fce9414bd15d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:04.066341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:04.067885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:04.072623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:04.073607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:04.075863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:04.076380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:04.082491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:04.164951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:04.264694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f805fa-caad-4a5b-ab14-730741b32401 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:04.280015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:04.280993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:04.281437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:04.281883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] PATH_INFO: `/v3/projects/94ad779db32746a2ab72a23e2702bf88` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:04.288322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:04.288840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ad779db32746a2ab72a23e2702bf88)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:04.290443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:04.290918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:04.320774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 873/1711] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:04.509387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ad779db32746a2ab72a23e2702bf88', 'request_id': 'req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:04.606479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ad779db32746a2ab72a23e2702bf88', 'request_id': 'req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:04.619674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ad779db32746a2ab72a23e2702bf88', 'request_id': 'req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:04.640214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] The token cache is being invalidate because project 94ad779db32746a2ab72a23e2702bf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:04.640759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:04.645472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:04.647697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 839/1712] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:04 2022] DELETE /identity/v3/projects/94ad779db32746a2ab72a23e2702bf88 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:04.651897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:04.673736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5982c-997a-4e85-ac40-f278c57fc7a4 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:04.810750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:04.811685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:04.812169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:04.812693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] PATH_INFO: `/v3/users/6704e51951e94d4eb4d126e158ad5362` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:04.815900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6704e51951e94d4eb4d126e158ad5362)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:04.818932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:05.062593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6704e51951e94d4eb4d126e158ad5362'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:05.094961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6704e51951e94d4eb4d126e158ad5362'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:05.112846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6704e51951e94d4eb4d126e158ad5362'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:05.197890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6704e51951e94d4eb4d126e158ad5362'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:05.198713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6704e51951e94d4eb4d126e158ad5362'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:05.210949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 874/1713] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:04 2022] DELETE /identity/v3/users/6704e51951e94d4eb4d126e158ad5362 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:05.643648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:05.648904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:05.682875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc3c42-5cfe-41a4-a4ad-6a4ca9e8e4fb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:05.725914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:05.864803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:05.865468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:05.865749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:05.866026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] PATH_INFO: `/v3/projects/229938df9c2b4e37999575d33d953320` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:05.868840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229938df9c2b4e37999575d33d953320)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:05.870791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:06.190894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229938df9c2b4e37999575d33d953320', 'request_id': 'req-d71440ab-d289-48dc-aad0-13ca2cca9129'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.301035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229938df9c2b4e37999575d33d953320', 'request_id': 'req-d71440ab-d289-48dc-aad0-13ca2cca9129'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.311546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229938df9c2b4e37999575d33d953320', 'request_id': 'req-d71440ab-d289-48dc-aad0-13ca2cca9129'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.338904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] The token cache is being invalidate because project 229938df9c2b4e37999575d33d953320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:06.338904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.340504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:06.342000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:06.347152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d71440ab-d289-48dc-aad0-13ca2cca9129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.356218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 840/1714] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:05 2022] DELETE /identity/v3/projects/229938df9c2b4e37999575d33d953320 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:06.362869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1d0c-d5aa-4833-bb34-28ce2f3e2a5a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.363508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1d0c-d5aa-4833-bb34-28ce2f3e2a5a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.364092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1d0c-d5aa-4833-bb34-28ce2f3e2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.364629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ebe2-5ee0-45a5-ad59-a3262dfea68f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:06.414379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-29fe1d0c-d5aa-4833-bb34-28ce2f3e2a5a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:06.416219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29fe1d0c-d5aa-4833-bb34-28ce2f3e2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:06.461546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:06.464334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.465236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.465672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] PATH_INFO: `/v3/users/55b45dd4422f458a8aa6467801a3f5ab` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.471891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b45dd4422f458a8aa6467801a3f5ab)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:06.474206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:06.501994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:06.543285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 841/1715] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:06.551907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.552909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.553195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.630422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:06.639223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:06.662945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 842/1716] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:06.666365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:06.678778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b666a-7b37-4afb-8d63-787e106adb29 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:06.686099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:06.716112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:06.716636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 843/1717] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:06.719096 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:06.743683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c8e2-635a-43b2-b1ad-3cf19c5d5e30 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:06.752267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:06.752875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.753358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.753689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.754688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:06.757073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191f10d-01b1-4cc9-8e25-a7913a2185e1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:06.794644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b45dd4422f458a8aa6467801a3f5ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.848945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b45dd4422f458a8aa6467801a3f5ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.863266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b45dd4422f458a8aa6467801a3f5ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.925714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 844/1718] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:06.927430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf54b3-5777-466f-be2a-f7f9aebfbd78 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:06.929470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf54b3-5777-466f-be2a-f7f9aebfbd78 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:06.930286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf54b3-5777-466f-be2a-f7f9aebfbd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:06.969482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b45dd4422f458a8aa6467801a3f5ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.971225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b45dd4422f458a8aa6467801a3f5ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:06.984349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 875/1719] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:06 2022] DELETE /identity/v3/users/55b45dd4422f458a8aa6467801a3f5ab => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:06.985923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:06.989413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:07.006261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c5bf54b3-5777-466f-be2a-f7f9aebfbd78 None None] MFA Rules not processed for user `7024eea9fd7a4859b305e9f7258b9e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:07.012879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c5bf54b3-5777-466f-be2a-f7f9aebfbd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:07.173891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 845/1720] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:07.175490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.175791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.176101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.201648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:07.203047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:07.203461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09236910-de30-49ba-8f59-6ad2df8e147d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:07.218314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:07.218314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.218314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.218314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.220998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:07.221966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 846/1721] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:07.223936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:07.232888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:07.236526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:07.378471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 876/1722] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:06 2022] POST /identity/v3/users => generated 289 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:07.383319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:07.404080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6404d3a-5b2f-4c4e-92f6-84a526b392b5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:07.411947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:07.411947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.411947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.412253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.428383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:07.431092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:07.456613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed95dbd-009b-4d7a-9428-5b1ea2d968d8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:07.460919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 847/1723] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:07.479511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:07.480625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.480841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.481110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.483883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:07.493593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:07.539304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 877/1724] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:07.542550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:07.557074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8091-6e5c-467e-ab63-e8540e6b8512 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:07.580322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:07.581108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.581262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.581529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.582278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:07.584193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332048-729e-48fa-9bbe-a5d5491c1527 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:07.604335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 848/1725] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:07.607645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:07.625260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b390e8b-3647-4681-8a91-b2eb62dbb45a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:07.649666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:07.651092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.656100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.656100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] PATH_INFO: `/v3/projects/554a55322f924b65a262edc04f31b5c4/users/30bbd6734bfe45c0a5abe1bbce8576c7/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.692362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=554a55322f924b65a262edc04f31b5c4, user_id=30bbd6734bfe45c0a5abe1bbce8576c7, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:07.699224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:07.838910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 878/1726] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:07 2022] PUT /identity/v3/projects/554a55322f924b65a262edc04f31b5c4/users/30bbd6734bfe45c0a5abe1bbce8576c7/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:07.839365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:07.840264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:07.840639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:07.906609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] MFA Rules not processed for user `30bbd6734bfe45c0a5abe1bbce8576c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:07.909815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:08.057110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 849/1727] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:08.062395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:08.268519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b927-1042-4ebb-bc4f-c7f9e1ff667e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:08.303306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:08.305407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:08.305715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:08.310504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:08.315397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:08.322098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:08.470576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 879/1728] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:08 2022] POST /identity/v3/projects => generated 377 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:08.475668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:08.495036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e3f99-c058-4d29-92ab-884be9bc2028 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:08.563133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:08.646987 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:08.660435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:08.662457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:08.662905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:08.664197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:08.670439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:08.819383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 850/1729] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:08 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:08.820267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:08.823067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:08.836900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:08.844187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78079b06-7798-4774-8d14-a3ffbaf8af02 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:08.859238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7bb2-6009-4aa2-ae80-99a31f87a883 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:08.874751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:08.875406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:08.875943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:08.876417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] PATH_INFO: `/v3/projects/58b8f9eaf2c6476187311cb688dd120d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:08.877744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:08.879028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b8f9eaf2c6476187311cb688dd120d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:08.884637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:08.895908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:08.896461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:08.898617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:08.899510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:08.903218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1e8e-d41b-40fb-aacb-3d84399a7a7e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:08.971996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 851/1730] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:08.991602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:08.992502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:08.996101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:09.148318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:09.155378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:09.205806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b8f9eaf2c6476187311cb688dd120d', 'request_id': 'req-f4e629a1-2c92-4300-be21-03a86bcc1789'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:09.255023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b8f9eaf2c6476187311cb688dd120d', 'request_id': 'req-f4e629a1-2c92-4300-be21-03a86bcc1789'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:09.276565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b8f9eaf2c6476187311cb688dd120d', 'request_id': 'req-f4e629a1-2c92-4300-be21-03a86bcc1789'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:09.332426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:09.409368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] The token cache is being invalidate because project 58b8f9eaf2c6476187311cb688dd120d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:09.409843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:09.411610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:09.414688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 880/1731] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:08 2022] DELETE /identity/v3/projects/58b8f9eaf2c6476187311cb688dd120d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:09.416728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:09.422217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:09.441575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 852/1732] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:09.443591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:09.479418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb4da-d91e-4242-8a3e-7939a2f0affc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:09.700896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:09.701182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:09.701339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:09.701672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] PATH_INFO: `/v3/users/04adbe12a037455dac389dc91e3d6bfb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:09.717249 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] RBAC: Authorizing `identity:delete_user(user_id=04adbe12a037455dac389dc91e3d6bfb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:09.727643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e629a1-2c92-4300-be21-03a86bcc1789 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:09.730024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:09.777329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:09.787454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:09.788063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:09.790915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:09.792815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:09.806784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:09.842962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 881/1733] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:09.848242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:09.885894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b2b7-5471-4efe-b390-5b59fe82f14d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:09.900355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:09.901051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:09.901340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:09.901609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] PATH_INFO: `/v3/projects/dd0e38303ca547e496df539f8b244f98/users/1a6f6834e02942b8a0f50349dc654af8/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:09.936699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0e38303ca547e496df539f8b244f98, user_id=1a6f6834e02942b8a0f50349dc654af8, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:09.941068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:10.089492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 882/1734] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:09 2022] PUT /identity/v3/projects/dd0e38303ca547e496df539f8b244f98/users/1a6f6834e02942b8a0f50349dc654af8/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:10.090078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:10.102427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:10.120136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04adbe12a037455dac389dc91e3d6bfb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:10.156241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04adbe12a037455dac389dc91e3d6bfb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:10.173936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04adbe12a037455dac389dc91e3d6bfb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:10.175150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04adbe12a037455dac389dc91e3d6bfb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:10.283226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-51fb60f8-04eb-4624-b5e2-1e8a721e75df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04adbe12a037455dac389dc91e3d6bfb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:10.294598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 853/1735] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:09 2022] DELETE /identity/v3/users/04adbe12a037455dac389dc91e3d6bfb => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:10.294598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:10.294598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:10.294598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:10.356226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3e10-64a0-45b7-aa65-a699a171f7fe admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:10.389042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] MFA Rules not processed for user `1a6f6834e02942b8a0f50349dc654af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:10.390939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:10.473087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:10.474006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:10.474490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:10.474985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:10.489209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:10.605242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:10.608520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:10.629478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 883/1737] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:10:10.629593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 854/1737] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:10.635007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:10.641655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:10.967105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c56e8-33ba-4581-9d5e-454ee87f460b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:10.996414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:10.997272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:10.999217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:10.999217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:10.999217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:11.000543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:11.081470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:11.179683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 855/1738] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:10 2022] POST /identity/v3/projects => generated 377 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:11.183917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:11.202867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11c61-9fe2-45a6-83f4-cb8cf32c65b0 service swift] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:11.338510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:11.339302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:11.339928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:11.340442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:11.341251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:11.347185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:11.829279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 884/1739] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:11 2022] POST /identity/v3/users => generated 295 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:11.835686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:11.857326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c586-e391-4da2-a8f0-fc61cfcc3ace admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:11.877815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:11.878986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:11.880501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:11.882539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:11.886771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:11.891670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:11.896242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:11.902393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:11.913697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7a3-8f46-4a06-b341-0d329cee7d95 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:11.946215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:11.947510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:11.955215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 856/1740] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:11.961224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:11.975187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:11.976874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] PATH_INFO: `/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:11.978347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d9bb-27f5-4d5b-9950-36b44a253831 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:11.981135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d8dd1ead774d9d9ba2e400b7360376)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:11.987206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:11.988415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:11.999134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:12.000080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:12.002480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] PATH_INFO: `/v3/projects/33e142cb505944138d5cb83c5fd656c3/users/7feb0b994604441dac2235725e6675da/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:12.066626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e142cb505944138d5cb83c5fd656c3, user_id=7feb0b994604441dac2235725e6675da, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:12.066840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:12.083075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258d763-f018-4384-970e-57e191f70b14 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:12.313945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:12.340632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 857/1741] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:11 2022] PUT /identity/v3/projects/33e142cb505944138d5cb83c5fd656c3/users/7feb0b994604441dac2235725e6675da/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:12.342223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698df55-75a2-4562-a3cc-9157ead1db28 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:12.352007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698df55-75a2-4562-a3cc-9157ead1db28 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:12.352007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698df55-75a2-4562-a3cc-9157ead1db28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:12.424782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d8dd1ead774d9d9ba2e400b7360376', 'request_id': 'req-3789fb46-fce5-43eb-a621-efbe0973e49e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:12.453528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d8dd1ead774d9d9ba2e400b7360376', 'request_id': 'req-3789fb46-fce5-43eb-a621-efbe0973e49e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:12.463367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9698df55-75a2-4562-a3cc-9157ead1db28 None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:12.464708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9698df55-75a2-4562-a3cc-9157ead1db28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:12.505201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d8dd1ead774d9d9ba2e400b7360376', 'request_id': 'req-3789fb46-fce5-43eb-a621-efbe0973e49e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:12.597023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] The token cache is being invalidate because project f6d8dd1ead774d9d9ba2e400b7360376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:12.601449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:12.601449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:12.602705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 885/1742] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:11 2022] DELETE /identity/v3/projects/f6d8dd1ead774d9d9ba2e400b7360376 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:12.603593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:12.607266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:12.661687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 858/1743] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 13 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:12.664953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:12.665475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:12.667266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:12.757023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:12.765534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:12.886922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789fb46-fce5-43eb-a621-efbe0973e49e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:12.912821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:12.915823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:12.915823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:12.915823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:12.915823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:12.921568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:12.968181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 886/1744] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:12.970033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:13.029439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:13.036633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 859/1745] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:13.036633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:13.104644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9898501-50e3-4464-b06b-49b1fb313057 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:13.112025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43d3e-bed0-4b46-ab82-a921275c810a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:13.136723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:13.137614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.140410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.143340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.145049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:13.146079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.151519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.151519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] PATH_INFO: `/v3/projects/33e142cb505944138d5cb83c5fd656c3/users/7feb0b994604441dac2235725e6675da/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.151519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e142cb505944138d5cb83c5fd656c3, user_id=7feb0b994604441dac2235725e6675da, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:13.180736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553ff87-cc10-4ed3-8dfc-05ee575abb44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:13.191097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:13.192694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ba8c-2dfd-435c-8c22-9cddc08a40f5 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:13.211783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 887/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:13.213253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.213541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.213816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.230633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 860/1747] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:13 2022] PUT /identity/v3/projects/33e142cb505944138d5cb83c5fd656c3/users/7feb0b994604441dac2235725e6675da/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:13.241817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f7fd-b3e3-4abf-a0b9-69bb3625acb1 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.253719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f7fd-b3e3-4abf-a0b9-69bb3625acb1 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.254043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f7fd-b3e3-4abf-a0b9-69bb3625acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.319366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:13.321963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:13.341485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e2a0f7fd-b3e3-4abf-a0b9-69bb3625acb1 None None] MFA Rules not processed for user `7feb0b994604441dac2235725e6675da`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:13.347456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e2a0f7fd-b3e3-4abf-a0b9-69bb3625acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:13.500208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:13.575671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 861/1748] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:13.575671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.575671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.575671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.624800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] MFA Rules not processed for user `91c021bd2d524d16b5b3f11a2dab8b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:13.626595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:13.645615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 888/1749] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:13.647674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:13.650496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:13.658756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:13.773195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8d3db-ebad-4679-9493-90055b67bef9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:13.789848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:13.790694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.790982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.791258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.794990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 862/1750] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:13.795888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:13.813832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:13.818279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:13.823639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad948f-b2c4-4fef-b451-e16a0131d73b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:13.845623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:13.846382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.846731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.847014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.847695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:13.849363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 889/1751] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:13.862264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:13.863694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:13.903712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 863/1752] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:13.908131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:13.930590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97ef27-d2c2-4262-bb40-d063834bf90c service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:13.973768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:13.978957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:13.983300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:13.994692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:13.996862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.001229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:14.003097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.003798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:14.042302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c53e-0e08-497e-9ec5-88bc39973a62 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:14.056689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:14.062831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:14.065637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:14.066110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:14.083719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:14.226067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 890/1753] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:13 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:14.231198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:14.335906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.338080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.370353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 864/1754] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:14.453193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee2bd-6be9-44d9-bd71-050abe66f717 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:14.476951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:14.504618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:14.507022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:14.507471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:14.513451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.515265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.564239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:14.631591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 891/1755] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:14 2022] POST /identity/v3/users => generated 294 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:14.632769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:14.653849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ded6-2813-4074-bf7b-c9081d6a65e8 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:14.685371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:14.685934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:14.686285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:14.686480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:14.687320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.689322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.725449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 865/1756] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:14.730288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:14.753284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068576-9ba9-4a1f-898f-8e716df24946 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:14.761368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:14.762088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:14.763108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:14.763409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:14.764552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.767342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7efa-a232-44ac-9ae2-9fff99a377e2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.794327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 892/1757] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:14.795254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:14.813227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbca45-c692-412a-a87b-150913e83e85 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:14.858119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:14.858912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:14.859203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:14.859488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] PATH_INFO: `/v3/projects/6b0667722acf486984821b843c5dc38c/users/d95a992fb93c4ecda16f89b375e2aee8/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:14.920315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0667722acf486984821b843c5dc38c, user_id=d95a992fb93c4ecda16f89b375e2aee8, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:14.924248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:14.963056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:15.021294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 866/1758] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:14 2022] PUT /identity/v3/projects/6b0667722acf486984821b843c5dc38c/users/d95a992fb93c4ecda16f89b375e2aee8/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:15.032610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:15.032932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:15.033303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:15.171050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] MFA Rules not processed for user `d95a992fb93c4ecda16f89b375e2aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:15.174187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:15.385539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 893/1759] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:15.390038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:15.552115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007076-3a8c-464d-adc4-7b7d78b7e832 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:15.581765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:15.582565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:15.583008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:15.583535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:15.584393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:15.586655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:15.704887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 867/1760] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:15 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:15.709428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:15.762688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c39c7-9b35-4e5a-8dfe-0406c98f495d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:15.973690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:15.974348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:15.978004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:15.978294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:15.979052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:15.981061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:16.125688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:16.147177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 894/1761] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:15 2022] POST /identity/v3/users => generated 300 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:16.149938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:16.175545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286b-6715-4060-9f1a-f35cbe3a65d9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:16.181045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:16.181855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:16.182175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:16.182416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:16.183183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:16.185126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:16.201119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 868/1762] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:16.204070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:16.219453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06b5f-0701-4c69-bd0e-2976a14b0c05 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:16.234415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:16.237501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:16.237858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:16.238093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] PATH_INFO: `/v3/projects/3d3aafffc48744dd970cbf88a4c62c27/users/5ec01141826a445da57bf5ee74884222/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:16.279114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3aafffc48744dd970cbf88a4c62c27, user_id=5ec01141826a445da57bf5ee74884222, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:16.285220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:16.418614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:16.429188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 895/1763] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:16 2022] PUT /identity/v3/projects/3d3aafffc48744dd970cbf88a4c62c27/users/5ec01141826a445da57bf5ee74884222/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:16.436015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e469a65-4fc5-4d30-80b3-f6da81639f29 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:16.454924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:16.585905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:16.589059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:16.589518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:16.589927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:16.590989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:16.599291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a2c29-86df-4021-8dd3-80cfeb7d49a7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:16.656473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 869/1764] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:16.664727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:16.686341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22392bc-3420-4c41-afb5-27d113d11523 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:16.700308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:16.701354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:16.701985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:16.702575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] PATH_INFO: `/v3/projects/3d3aafffc48744dd970cbf88a4c62c27/users/5ec01141826a445da57bf5ee74884222/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:16.711198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3aafffc48744dd970cbf88a4c62c27, user_id=5ec01141826a445da57bf5ee74884222, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:16.717266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:16.737911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 896/1765] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:16 2022] PUT /identity/v3/projects/3d3aafffc48744dd970cbf88a4c62c27/users/5ec01141826a445da57bf5ee74884222/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:16.749627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:16.750056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:16.750442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:16.792268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] MFA Rules not processed for user `5ec01141826a445da57bf5ee74884222`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:16.793689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:16.944985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 870/1766] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:16.963118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:17.197195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7210-a5aa-420b-8eb3-269885d0e626 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:17.215459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:17.217276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:17.220662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:17.220943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:17.274730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:17.276701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27c74-3890-42a6-ba94-e61465331a12 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:17.317287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 897/1767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:17.372701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:17.588302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbab4-f694-4d21-ae5f-7e6497798aa0 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:17.606012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:17.606757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:17.607206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:17.607383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] PATH_INFO: `/v3/users/d95a992fb93c4ecda16f89b375e2aee8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:17.610997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95a992fb93c4ecda16f89b375e2aee8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:17.611326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:17.883694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95a992fb93c4ecda16f89b375e2aee8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:17.913923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95a992fb93c4ecda16f89b375e2aee8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:17.933748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95a992fb93c4ecda16f89b375e2aee8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:17.934677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95a992fb93c4ecda16f89b375e2aee8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:18.034965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95a992fb93c4ecda16f89b375e2aee8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:18.044058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 871/1768] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:17 2022] DELETE /identity/v3/users/d95a992fb93c4ecda16f89b375e2aee8 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:18.047001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fac53-a417-40e7-b331-60a48fd0b1f7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:18.048758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fac53-a417-40e7-b331-60a48fd0b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:18.049959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fac53-a417-40e7-b331-60a48fd0b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:18.135569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fc3fac53-a417-40e7-b331-60a48fd0b1f7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:18.143893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc3fac53-a417-40e7-b331-60a48fd0b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:18.165124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:18.317633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 898/1769] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:18.380152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:18.382545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:18.432191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859a03-09ae-4239-9f0e-519a8e20df05 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:18.432878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859a03-09ae-4239-9f0e-519a8e20df05 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:18.433471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859a03-09ae-4239-9f0e-519a8e20df05 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:18.435509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 899/1770] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:10:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:10:18.568511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:18.568511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:18.568848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:18.642729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:18.645375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:18.675511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae12a5-b4e3-43a2-81ee-d804c5b7451b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:18.687389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:18.690225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:18.692895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:18.694254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:18.733958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:18.752264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:18.754340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22994a97-9f38-4449-875c-882a9e7d9ca0 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:18.788875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 900/1771] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:18.856595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 872/1772] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:19.352829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:19.354346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:19.386572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aecdce-e33b-41a2-bfe0-3fc732ab782e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:19.418985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:19.419747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:19.420460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:19.421649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] PATH_INFO: `/v3/users/4c9db03e1362446c8c04aecee5235a33` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:19.428592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9db03e1362446c8c04aecee5235a33)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:19.432637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:19.514680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb055d-4fe4-4346-b080-aa7f8101b3c9 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:19.515358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb055d-4fe4-4346-b080-aa7f8101b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:19.515841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb055d-4fe4-4346-b080-aa7f8101b3c9 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:19.518476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 873/1773] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:10:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 08:10:19.615825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:19.616683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:19.617383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:19.667014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:19.669060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:19.706892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 874/1774] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:10:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:19.706892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:19.711941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:19.757303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889925-710e-4e92-bb4c-c4704f933866 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:19.781115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:19.783592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:19.785146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:19.785756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:19.798957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:19.801181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:19.839964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 875/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:19.994216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9db03e1362446c8c04aecee5235a33'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:20.032809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9db03e1362446c8c04aecee5235a33'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:20.047335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9db03e1362446c8c04aecee5235a33'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:20.083097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:20.107002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9c932-e423-4045-a1e3-2aea241bbb0a service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:20.117192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:20.118733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:20.119192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:20.119688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:20.131403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:20.133242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e53e-7fe1-4432-b2ed-81c22d29888a service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:20.184764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 876/1776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:20.198013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9db03e1362446c8c04aecee5235a33'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:20.199230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9db03e1362446c8c04aecee5235a33'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:20.214061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 901/1777] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:19 2022] DELETE /identity/v3/users/4c9db03e1362446c8c04aecee5235a33 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:20.217511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:20.217869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:20.218217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:20.257232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:20.258569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:20.365136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 877/1778] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:20.678728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:20.681221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:20.697515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:20.698939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:20.702624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:20.710253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3789cf-b0f1-4817-bd97-86ea6f4c2d14 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:20.721381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:20.724691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:20.726260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:20.727179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] PATH_INFO: `/v3/users/30bbd6734bfe45c0a5abe1bbce8576c7` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:20.731335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bbd6734bfe45c0a5abe1bbce8576c7)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:20.735768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:20.832640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b891fb-41cc-4df2-9baa-c33a1a0bb3d2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:20.845422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:20.846066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:20.846347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:20.846843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:20.880224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:20.881948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:20.899746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 878/1779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:21.012665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bbd6734bfe45c0a5abe1bbce8576c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.046538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bbd6734bfe45c0a5abe1bbce8576c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.073314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bbd6734bfe45c0a5abe1bbce8576c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.185273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bbd6734bfe45c0a5abe1bbce8576c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.186936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3c75f193-e1ba-4eb7-8347-680951417d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bbd6734bfe45c0a5abe1bbce8576c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.191877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:21.193660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:21.204547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 902/1780] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:20 2022] DELETE /identity/v3/users/30bbd6734bfe45c0a5abe1bbce8576c7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:21.209753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:21.212111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:21.213632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:21.218948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b063-61ea-4851-b651-f3c792d9b3b8 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:21.302451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:21.307078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:21.344999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:21.345756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:21.345949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:21.346209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] PATH_INFO: `/v3/projects/6b0667722acf486984821b843c5dc38c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:21.347428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0667722acf486984821b843c5dc38c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:21.349475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:21.522777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 903/1781] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:21.556151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:21.588856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0667722acf486984821b843c5dc38c', 'request_id': 'req-ccd62972-eb4b-4618-8c12-df79fae3279f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.651573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:21.658959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:21.693021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0667722acf486984821b843c5dc38c', 'request_id': 'req-ccd62972-eb4b-4618-8c12-df79fae3279f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.724415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0667722acf486984821b843c5dc38c', 'request_id': 'req-ccd62972-eb4b-4618-8c12-df79fae3279f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.776318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] The token cache is being invalidate because project 6b0667722acf486984821b843c5dc38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:21.778408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.783017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:21.785864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 879/1782] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:21 2022] DELETE /identity/v3/projects/6b0667722acf486984821b843c5dc38c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:21.795373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:21.800423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:21.899462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0cd8e-4cfb-4ffb-9d2e-0639fe6fb084 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:21.956187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62972-eb4b-4618-8c12-df79fae3279f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:21.971152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:21.971824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:21.972135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:21.975612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] PATH_INFO: `/v3/users/5ec01141826a445da57bf5ee74884222` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:21.978433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec01141826a445da57bf5ee74884222)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:21.987027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:22.052432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:22.053464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:22.055343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:22.056703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:22.070040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:22.112794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:22.116039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:22.144264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 904/1783] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:22.401240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec01141826a445da57bf5ee74884222'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:22.433370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec01141826a445da57bf5ee74884222'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:22.458960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec01141826a445da57bf5ee74884222'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:22.473141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec01141826a445da57bf5ee74884222'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:22.613285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec01141826a445da57bf5ee74884222'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:22.621484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 880/1784] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:21 2022] DELETE /identity/v3/users/5ec01141826a445da57bf5ee74884222 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:23.819350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:23.821554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:23.840118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6b47-d746-42c1-9bd8-886610ce1bda service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:23.955658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:23.994544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:23.995150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:23.995435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:23.996026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] PATH_INFO: `/v3/projects/1d5ff6b06a8945768feabaea3b128d3f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:23.997276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5ff6b06a8945768feabaea3b128d3f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:23.999202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:24.187042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5ff6b06a8945768feabaea3b128d3f', 'request_id': 'req-ec20d258-58fa-4f34-b911-4b44438113d0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.193425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5ff6b06a8945768feabaea3b128d3f', 'request_id': 'req-ec20d258-58fa-4f34-b911-4b44438113d0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.200894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5ff6b06a8945768feabaea3b128d3f', 'request_id': 'req-ec20d258-58fa-4f34-b911-4b44438113d0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.300436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] The token cache is being invalidate because project 1d5ff6b06a8945768feabaea3b128d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:24.300735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.301702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.307553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 905/1785] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:23 2022] DELETE /identity/v3/projects/1d5ff6b06a8945768feabaea3b128d3f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:24.311872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:24.314055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:24.333499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07567c5-53ba-4a05-904c-7714a7cd83c1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:24.409077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:24.411638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:24.411638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:24.411638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] PATH_INFO: `/v3/users/1aa7cae8b7d646c08ecb1fa085977eb5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:24.412620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa7cae8b7d646c08ecb1fa085977eb5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:24.415316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:24.448346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:24.449890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:24.471297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d258-58fa-4f34-b911-4b44438113d0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:24.484153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:24.485554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:24.485982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:24.486455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] PATH_INFO: `/v3/projects/3d3aafffc48744dd970cbf88a4c62c27` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:24.490298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3aafffc48744dd970cbf88a4c62c27)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:24.492681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:24.634398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa7cae8b7d646c08ecb1fa085977eb5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.667808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa7cae8b7d646c08ecb1fa085977eb5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.680988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa7cae8b7d646c08ecb1fa085977eb5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.682126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa7cae8b7d646c08ecb1fa085977eb5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.707244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3aafffc48744dd970cbf88a4c62c27', 'request_id': 'req-3a74c375-c051-4fdc-932d-33c5970454ce'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.728333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3aafffc48744dd970cbf88a4c62c27', 'request_id': 'req-3a74c375-c051-4fdc-932d-33c5970454ce'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.734432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:24.742154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3aafffc48744dd970cbf88a4c62c27', 'request_id': 'req-3a74c375-c051-4fdc-932d-33c5970454ce'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.770789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-252f60c1-3c79-4ec0-afdf-c72364cfcc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa7cae8b7d646c08ecb1fa085977eb5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.778614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 881/1786] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:24 2022] DELETE /identity/v3/users/1aa7cae8b7d646c08ecb1fa085977eb5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:24.863115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] The token cache is being invalidate because project 3d3aafffc48744dd970cbf88a4c62c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:24.864212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.869066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3a74c375-c051-4fdc-932d-33c5970454ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:24.870906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 906/1787] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:24 2022] DELETE /identity/v3/projects/3d3aafffc48744dd970cbf88a4c62c27 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:24.880014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:24.880243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:24.880677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:24.925623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:24.927099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:25.097029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 882/1788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:25.105745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:25.107752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:25.108153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:25.145375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:25.146988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:25.177440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 907/1789] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:25.178503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:25.198012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1982e7-d9db-449e-9063-45073b69e46f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:25.216652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:25.216652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:25.216652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:25.216652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:25.220863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:25.221200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:25.224694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:25.289310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 883/1790] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:25.291008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:25.318238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd809-0160-4b6e-a9d1-cd6e6ae01d45 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:25.334144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:25.334523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:25.335195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:25.335195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:25.335730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:25.337766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:25.506167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 908/1791] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:25 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:25.507665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:25.521673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b979-0286-4a32-b6da-bfef99550271 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:25.653298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:25.653298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:25.653298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:25.653298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:25.653667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:25.653667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:25.988478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:25.990462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.006246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dbc01-4d92-48e7-bdfd-5665803cc97f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.011755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.012682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.013165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.013654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] PATH_INFO: `/v3/projects/554a55322f924b65a262edc04f31b5c4` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.015020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554a55322f924b65a262edc04f31b5c4)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.017997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.050272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 884/1792] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:25 2022] POST /identity/v3/users => generated 282 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:26.051550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.053425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.066729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4c0e-11c9-48bb-b896-198adbc8f637 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.071532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.072326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.072730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.073114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] PATH_INFO: `/v3/projects/c014f2e8548940509ef0654953e4915a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.074343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c014f2e8548940509ef0654953e4915a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.076729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.209583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554a55322f924b65a262edc04f31b5c4', 'request_id': 'req-4ec8cf1c-6f8e-4762-9d66-f27aca518226'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.215664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554a55322f924b65a262edc04f31b5c4', 'request_id': 'req-4ec8cf1c-6f8e-4762-9d66-f27aca518226'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.222058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554a55322f924b65a262edc04f31b5c4', 'request_id': 'req-4ec8cf1c-6f8e-4762-9d66-f27aca518226'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.260629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c014f2e8548940509ef0654953e4915a', 'request_id': 'req-36a06328-adfa-4b75-b8b2-48915738f4a8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.340863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] The token cache is being invalidate because project 554a55322f924b65a262edc04f31b5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:26.341375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.342676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.347563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 909/1793] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:25 2022] DELETE /identity/v3/projects/554a55322f924b65a262edc04f31b5c4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:26.349131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.351251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.419291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c014f2e8548940509ef0654953e4915a', 'request_id': 'req-36a06328-adfa-4b75-b8b2-48915738f4a8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.429396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c014f2e8548940509ef0654953e4915a', 'request_id': 'req-36a06328-adfa-4b75-b8b2-48915738f4a8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.432120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8cf1c-6f8e-4762-9d66-f27aca518226 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.450503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] The token cache is being invalidate because project c014f2e8548940509ef0654953e4915a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:26.451416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.452647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.458038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 885/1794] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:26 2022] DELETE /identity/v3/projects/c014f2e8548940509ef0654953e4915a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:26.458038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.460187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.546057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.546686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.546967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.547783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.548715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.550412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20705930-41fb-4d5c-a706-f9242245d457 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.552964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a06328-adfa-4b75-b8b2-48915738f4a8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.559032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.560159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.560668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.561237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] PATH_INFO: `/v3/users/1a6f6834e02942b8a0f50349dc654af8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.562519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6f6834e02942b8a0f50349dc654af8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.563042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 910/1795] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:26.566546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.566546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.566546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.572723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.596018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:26.597265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.607432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 911/1796] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:26.609026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.610991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.624434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:26.627334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85713a35-675d-431d-b926-5360d1ca8012 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.632352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.632975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.633253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.635763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.635763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.636098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ca7ce-f6d5-41fb-9d88-b13759324e27 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.647024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 912/1797] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:26.652664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.652664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.652664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.685096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:26.685965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.695301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 913/1798] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:26.700021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.714362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb7f26-0191-4d28-9229-b6d39bda6396 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.716455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.717129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.717411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.717685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] PATH_INFO: `/v3/projects/f329531091994b6587cdc46c67eaf5ff/users/2d691267236e49888f4243f8fe2f7b44/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.732712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f329531091994b6587cdc46c67eaf5ff, user_id=2d691267236e49888f4243f8fe2f7b44, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:26.736242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:26.759765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6f6834e02942b8a0f50349dc654af8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.774920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6f6834e02942b8a0f50349dc654af8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.782771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6f6834e02942b8a0f50349dc654af8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.783640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6f6834e02942b8a0f50349dc654af8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.835351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 914/1799] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:26 2022] PUT /identity/v3/projects/f329531091994b6587cdc46c67eaf5ff/users/2d691267236e49888f4243f8fe2f7b44/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:26.835351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:26.835351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.864673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bc6e9d13-2212-47da-b3b1-87ca87b82a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6f6834e02942b8a0f50349dc654af8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:26.873271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 886/1800] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:26 2022] DELETE /identity/v3/users/1a6f6834e02942b8a0f50349dc654af8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:26.876738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:26.877348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:26.878020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:26.915281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:26.923703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fc5e-0524-44e9-8eab-4b42e49cf165 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:26.934305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] MFA Rules not processed for user `2d691267236e49888f4243f8fe2f7b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:26.936025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:26.999130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:26.999755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.001260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.009357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.009357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:27.009357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.009357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.020415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 915/1801] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:27.021787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.028792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 887/1802] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:27.033442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bba8b-856a-4894-8a64-c4c12eda3f7f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.033573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.035070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:27.039374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.040095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.040443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.040782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.041520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.043529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.053236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528942a7-8adb-43f8-bcd1-9afc3325e59d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.058594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.059572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.059823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.060198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.060924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.065018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.186285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 916/1803] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:27 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:27.186518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 888/1804] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:27 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:27.187698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.190605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.377308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196a43d-65cb-4055-9e12-7d747b8e5a7f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.381145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8c4f-e327-492b-bd6d-9cf9880c1142 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.397409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.404035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.404777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.404777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.404777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.404777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.405058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.405214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.405214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.405214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.405848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.410289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.517938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 889/1805] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:27 2022] POST /identity/v3/users => generated 290 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:27.521867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.532243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64282-68da-42eb-8968-0af1def31bdb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.536464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.537041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.537352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.537625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.538256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.539826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.550836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 890/1806] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:27.559374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.567842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 917/1807] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:27 2022] POST /identity/v3/users => generated 283 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:27.573423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.576018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068d15-45b2-4c75-8b1c-8dc778827fc6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.579022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:27.592409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.592409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.592409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.592409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] PATH_INFO: `/v3/projects/abc2b273dc8342e2b128ccb4e629ad05/users/83704280b0e4411ba1e6bfc2083456bf/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.600765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eec5e-d4ed-471f-a4d2-be867ba22998 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.607619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc2b273dc8342e2b128ccb4e629ad05, user_id=83704280b0e4411ba1e6bfc2083456bf, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.611849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.617293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.621369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.621869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.622319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] PATH_INFO: `/v3/projects/dd0e38303ca547e496df539f8b244f98` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.623659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0e38303ca547e496df539f8b244f98)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.626893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.704022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 891/1808] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:27 2022] PUT /identity/v3/projects/abc2b273dc8342e2b128ccb4e629ad05/users/83704280b0e4411ba1e6bfc2083456bf/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:27.704629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.742839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0e38303ca547e496df539f8b244f98', 'request_id': 'req-86b92e85-4183-45b3-8775-0c95c3131d42'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:27.751951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0e38303ca547e496df539f8b244f98', 'request_id': 'req-86b92e85-4183-45b3-8775-0c95c3131d42'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:27.762715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0e38303ca547e496df539f8b244f98', 'request_id': 'req-86b92e85-4183-45b3-8775-0c95c3131d42'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:27.803565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aec9f-b9c6-4aee-9471-1959a6ee0002 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.842678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:27.877605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] The token cache is being invalidate because project dd0e38303ca547e496df539f8b244f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:27.881024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:27.881024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:27.881229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.881229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.881229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.881568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.882298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.883683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 918/1809] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:27 2022] DELETE /identity/v3/projects/dd0e38303ca547e496df539f8b244f98 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:27.884432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.884754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.886395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:27.897007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 892/1810] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:27.898003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.906203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:27.915240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e85-4183-45b3-8775-0c95c3131d42 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.920131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311eb1a-7893-4045-a033-f6f567671a42 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.921155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.921771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.922191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.922466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.923097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.925030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.926079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.926741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.927016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.927287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] PATH_INFO: `/v3/users/7feb0b994604441dac2235725e6675da` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.928588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feb0b994604441dac2235725e6675da)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.930568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.937140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 919/1811] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:27.937545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.940239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:27.958257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0aff9-40e4-4a21-9fef-09cd7f83a03d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.962956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.963554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.963828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.964205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.964831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.966481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:27.977196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 920/1812] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:27.978424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:27.988595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6a37-e38e-451c-91b4-a6219b6bbd7a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:27.993169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:27.993757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:27.994033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:27.994302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] PATH_INFO: `/v3/projects/abc2b273dc8342e2b128ccb4e629ad05/users/83704280b0e4411ba1e6bfc2083456bf/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:27.996212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc2b273dc8342e2b128ccb4e629ad05, user_id=83704280b0e4411ba1e6bfc2083456bf, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:27.998870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.009831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 921/1813] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:27 2022] PUT /identity/v3/projects/abc2b273dc8342e2b128ccb4e629ad05/users/83704280b0e4411ba1e6bfc2083456bf/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:28.013983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.070992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a815-5919-4357-a0f4-87aea840a051 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.075584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.076284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.076568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.076842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] PATH_INFO: `/v3/projects/1988779508254f4086cd10e18e78b162/users/2b3813d831354b2fac93a99d80b62401/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.092053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1988779508254f4086cd10e18e78b162, user_id=2b3813d831354b2fac93a99d80b62401, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:28.095370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ba723-2fdc-4917-a423-9e11ed61146c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.208966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 922/1814] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:28 2022] PUT /identity/v3/projects/1988779508254f4086cd10e18e78b162/users/2b3813d831354b2fac93a99d80b62401/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:28.210462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1aa4-c9ce-4585-8677-0cf5a185ab53 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.210750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1aa4-c9ce-4585-8677-0cf5a185ab53 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.211023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1aa4-c9ce-4585-8677-0cf5a185ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.229336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feb0b994604441dac2235725e6675da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:28.242105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feb0b994604441dac2235725e6675da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:28.244091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f14c1aa4-c9ce-4585-8677-0cf5a185ab53 None None] MFA Rules not processed for user `83704280b0e4411ba1e6bfc2083456bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:28.245270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f14c1aa4-c9ce-4585-8677-0cf5a185ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:28.250060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feb0b994604441dac2235725e6675da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:28.251033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feb0b994604441dac2235725e6675da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:28.312824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 923/1815] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:28.314136 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.314429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.314703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.345972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] MFA Rules not processed for user `2b3813d831354b2fac93a99d80b62401`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:28.347158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:28.354514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feb0b994604441dac2235725e6675da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:28.366692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 893/1816] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:27 2022] DELETE /identity/v3/users/7feb0b994604441dac2235725e6675da => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:28.366692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.375253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:28.380265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:28.433160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 924/1817] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:28.434988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.436546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:28.489323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557dda6-12d6-4bbb-9f9d-3368a9215d6d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.496772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.497121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.497435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.497704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.542586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699460c6-b267-4fc1-97e1-3f5fb400cc23 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.577794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:28.579494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.590498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 894/1818] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:28.605616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.606197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.606484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.606757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.607395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:28.609876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.748106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 925/1819] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:28 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:28.750806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.761612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b44ffa-cc7c-4984-b6c0-8ea075c6a900 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.822871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.823772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.824095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.824374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.825119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:28.827090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.872257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.943735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 895/1820] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:28 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:28.943735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:28.944282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:28.958129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d78b97-490e-4249-8f8a-76a3851a09fa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.958835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d21a-4602-40d2-823c-605af114a09a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:28.964996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.965376 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:28.966647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.966647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.966647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.972431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:28.972735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:28.973018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] PATH_INFO: `/v3/projects/33e142cb505944138d5cb83c5fd656c3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:28.974388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e142cb505944138d5cb83c5fd656c3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:28.976384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:28.983600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.055674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.057149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.069420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 926/1821] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:29.077595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.083658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b484d3-a6c7-4d57-b2ff-4b0f5e6aa78a service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.088681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.089414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.089793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.090163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.091408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.093949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.110979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 927/1822] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:29.112267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.128736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f578-8716-4189-a2ba-d1bea51046ab admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.129535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e142cb505944138d5cb83c5fd656c3', 'request_id': 'req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:29.200693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.203182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.203182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.203182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] PATH_INFO: `/v3/projects/f0bfcc99440241e3b14a782dc904878a/users/292df51f9a1245b88528f51ee2560d08/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.217258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bfcc99440241e3b14a782dc904878a, user_id=292df51f9a1245b88528f51ee2560d08, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.220538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.228767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e142cb505944138d5cb83c5fd656c3', 'request_id': 'req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:29.238758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e142cb505944138d5cb83c5fd656c3', 'request_id': 'req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:29.251385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] The token cache is being invalidate because project 33e142cb505944138d5cb83c5fd656c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:29.254814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:29.254814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f8acd97-1bdc-4b6f-8f4f-65089f6c9f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:29.254814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 896/1823] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:28 2022] DELETE /identity/v3/projects/33e142cb505944138d5cb83c5fd656c3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:29.260232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5e89-2eb7-4855-9e52-8602e116b521 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.260519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5e89-2eb7-4855-9e52-8602e116b521 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.260786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af5e89-2eb7-4855-9e52-8602e116b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.283097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-09af5e89-2eb7-4855-9e52-8602e116b521 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:29.283097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-09af5e89-2eb7-4855-9e52-8602e116b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.291320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 897/1824] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:29.300461 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.300732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.300969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.310078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 928/1825] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:29 2022] PUT /identity/v3/projects/f0bfcc99440241e3b14a782dc904878a/users/292df51f9a1245b88528f51ee2560d08/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:29.312862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.315265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.323189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:29.324502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.329803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:29.397115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ea7f-7d62-490b-90c6-fcf4a1fef229 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.403334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 898/1826] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:29.403505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.403505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.403505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.403505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.404055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.404799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.406111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.416883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50614b-f8e8-4554-8b7c-306e6b7fa14c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.418220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 929/1827] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:29.424693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.424868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.425468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.425758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.427142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.427142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:29.427142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.429630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.441663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347022c0-4f19-4700-b82b-3ec7f533c998 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.446906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.447646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.447927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.448234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] PATH_INFO: `/v3/projects/f0bfcc99440241e3b14a782dc904878a/users/292df51f9a1245b88528f51ee2560d08/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.450242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bfcc99440241e3b14a782dc904878a, user_id=292df51f9a1245b88528f51ee2560d08, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.455497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 899/1828] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:29.455669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e952-9eed-404d-a473-d3cd7bb4004a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.456605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.465726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 930/1829] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:29 2022] PUT /identity/v3/projects/f0bfcc99440241e3b14a782dc904878a/users/292df51f9a1245b88528f51ee2560d08/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:29.474958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c0078-abdd-4fb1-bed7-10039d79a72d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.476420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de644-0806-499e-923f-122521e7fc95 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.482828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de644-0806-499e-923f-122521e7fc95 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.482828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de644-0806-499e-923f-122521e7fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.517126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e08de644-0806-499e-923f-122521e7fc95 None None] MFA Rules not processed for user `292df51f9a1245b88528f51ee2560d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:29.518976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e08de644-0806-499e-923f-122521e7fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.592602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.593296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.593505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.595290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.595994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.603628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.612361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 931/1830] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:29.612934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:29.623270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08de644-0806-499e-923f-122521e7fc95 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.626630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e08de644-0806-499e-923f-122521e7fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.711355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08de644-0806-499e-923f-122521e7fc95 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.715639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.716285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.716564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.716837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.727281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.727799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 900/1831] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:29 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:29.728879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.729012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.748111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 932/1832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:29.806921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f808-1f13-45c6-a238-e3ebb6cd0cb9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.811893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.812578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.813642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.814055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.814911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.816891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.923542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 901/1833] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:29 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:29.928009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.939254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849f9d0-cb91-4dec-b4dc-456410dda64d service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:29.959448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:29.959448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:29.959448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:29.959448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:29.960244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:29.960244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:29.968367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.974831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 933/1834] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:29.975745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:29.975857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:29.986853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f6bd4-ffac-409d-83bf-41103b533e01 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.007378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.008302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.008594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.008876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.009532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.011252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.029224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 934/1835] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:30.044772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:30.059381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c9fe0-8040-4071-b086-84b291168cbb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.076591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.077346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.078191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.078191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] PATH_INFO: `/v3/projects/98a1ca4eb0514f12a5f45adf0ccade93/users/68d73f9fd10943dd837f249759dd5d25/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.108209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880194-1fa8-4a77-b719-0a312eba1875 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.108637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a1ca4eb0514f12a5f45adf0ccade93, user_id=68d73f9fd10943dd837f249759dd5d25, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.114059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.114874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee7632-e78d-47c1-9bc7-0fd5922f4269 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.115121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.115453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.115730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.117573 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:30.185416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:30.209695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.211234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.252462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 935/1836] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:30 2022] PUT /identity/v3/projects/98a1ca4eb0514f12a5f45adf0ccade93/users/68d73f9fd10943dd837f249759dd5d25/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:30.273968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.274274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.274533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.292905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 902/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:30.336892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] MFA Rules not processed for user `68d73f9fd10943dd837f249759dd5d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:30.338073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:30.454509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 936/1838] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:30.459278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:30.470415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de9ac-9544-4596-82e6-d84b88bfd3ec service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.533553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.534176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.534457 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.534730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.535364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.537610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.653501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 903/1839] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:30 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:30.654652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:30.666443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79917a-52c0-4bd2-9a30-eb95b9b227c7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.734084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.735373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.735719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.736400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.737096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.739087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.830430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 937/1840] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:30 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:30.835617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:30.848033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda47a1-1f80-448a-9e8d-59396c83184d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.852877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.853492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.853768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.854040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.854683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.856881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:30.873385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 904/1841] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:30.881314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:30.895056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1416a-0e7d-4386-b921-944b393a402d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:30.901373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:30.901373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:30.901635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:30.901839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] PATH_INFO: `/v3/projects/8a313413f234493f97f7072630033bed/users/7502682ad4d647b1a6527f0c08c1569e/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:30.938915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a313413f234493f97f7072630033bed, user_id=7502682ad4d647b1a6527f0c08c1569e, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:30.941807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:31.025602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 938/1842] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:30 2022] PUT /identity/v3/projects/8a313413f234493f97f7072630033bed/users/7502682ad4d647b1a6527f0c08c1569e/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:31.029925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:31.042079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8da3-0c0c-44d8-b750-8622c782e5e3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:31.102234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:31.102863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:31.103145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:31.103422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:31.104132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:31.105738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8f0b1-ec48-417c-bddf-c2b63e95c7d1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:31.117548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 905/1843] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:31.124157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:31.132399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365986-e2c5-4ceb-b36d-3c087f7d4dcc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:31.137173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:31.138448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:31.138739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:31.139013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] PATH_INFO: `/v3/projects/8a313413f234493f97f7072630033bed/users/7502682ad4d647b1a6527f0c08c1569e/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:31.141992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a313413f234493f97f7072630033bed, user_id=7502682ad4d647b1a6527f0c08c1569e, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:31.144620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:31.158266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 939/1844] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:31 2022] PUT /identity/v3/projects/8a313413f234493f97f7072630033bed/users/7502682ad4d647b1a6527f0c08c1569e/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:31.174912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:31.176881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:31.176881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:31.215729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] MFA Rules not processed for user `7502682ad4d647b1a6527f0c08c1569e`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:31.217433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:31.321572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 906/1845] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:31.336375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:31.410664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5ae0-a05d-45c4-a3f6-8f022aa4cba3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:31.415314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:31.415833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:31.416169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:31.416447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:31.425891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:31.441536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:31.443585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb6b4a-23a7-4175-ba6b-b2c9d4158112 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:31.456701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 940/1846] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:31.662591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:31.675731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64987-2ebb-4b58-8b80-1227ad5f4a1b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:31.681062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:31.681906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:31.682488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:31.682757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:31.756008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:31.757558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253fc7f-8514-43c2-a1bb-d3cf94499277 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:31.768705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 907/1847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:32.140763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:32.141747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:32.142098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:32.144746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 941/1848] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:10:32.167395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:32.167790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:32.168208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:32.192246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:32.193591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:32.303014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:32.349027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 908/1849] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:32.365554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:32.367542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:32.387559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3c23-490f-4d9c-9d7e-42c0565a52c8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:32.395148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:32.396271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:32.396271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:32.396481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:32.415142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:32.417033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ea1f-ae59-489e-bb5f-bbb48584ba75 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:32.464178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 942/1850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:32.480144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:32.558460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7406-b5be-4c7c-8f43-f044ab57b056 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:32.564851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:32.568139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:32.568139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:32.568139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] PATH_INFO: `/v3/users/68d73f9fd10943dd837f249759dd5d25` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:32.568139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d73f9fd10943dd837f249759dd5d25)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:32.569835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:32.812471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d73f9fd10943dd837f249759dd5d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:32.846693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d73f9fd10943dd837f249759dd5d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:32.861499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d73f9fd10943dd837f249759dd5d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:32.868503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d73f9fd10943dd837f249759dd5d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:32.933619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d73f9fd10943dd837f249759dd5d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:32.941944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 909/1851] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:32 2022] DELETE /identity/v3/users/68d73f9fd10943dd837f249759dd5d25 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:32.949661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:32.949955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:32.950231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:32.990325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:32.991529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:33.055308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 943/1852] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:33.065289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:33.066703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:33.098267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:33.156959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61a707-a566-4c64-8bb1-c3712139312e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:33.163721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:33.164552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:33.164830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:33.176697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:33.190185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:33.191849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:33.205944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 910/1853] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:33.819703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:33.821732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:33.843294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b2c4-5fe7-425a-98d9-1a32850d551b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:33.865129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:33.866947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:33.867643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:33.868812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] PATH_INFO: `/v3/projects/98a1ca4eb0514f12a5f45adf0ccade93` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:33.897923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a1ca4eb0514f12a5f45adf0ccade93)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:33.908842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:34.095113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a1ca4eb0514f12a5f45adf0ccade93', 'request_id': 'req-f4b962f4-4dd9-481f-a180-90081b220289'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.104271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a1ca4eb0514f12a5f45adf0ccade93', 'request_id': 'req-f4b962f4-4dd9-481f-a180-90081b220289'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.110435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a1ca4eb0514f12a5f45adf0ccade93', 'request_id': 'req-f4b962f4-4dd9-481f-a180-90081b220289'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.200550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] The token cache is being invalidate because project 98a1ca4eb0514f12a5f45adf0ccade93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:34.200711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.206004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.206004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 944/1854] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:33 2022] DELETE /identity/v3/projects/98a1ca4eb0514f12a5f45adf0ccade93 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:34.209161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:34.229305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404f2d-8002-4f24-b442-c5c6b0acc1d1 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:34.319952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:34.320628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:34.320911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:34.321192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] PATH_INFO: `/v3/users/7502682ad4d647b1a6527f0c08c1569e` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:34.322321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7502682ad4d647b1a6527f0c08c1569e)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:34.324395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:34.349364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:34.576408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7502682ad4d647b1a6527f0c08c1569e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.590712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7502682ad4d647b1a6527f0c08c1569e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.598817 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7502682ad4d647b1a6527f0c08c1569e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.599645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7502682ad4d647b1a6527f0c08c1569e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.688268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e51746a0-b868-4bcd-844a-793fa1562e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7502682ad4d647b1a6527f0c08c1569e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:34.694932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 911/1855] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:34 2022] DELETE /identity/v3/users/7502682ad4d647b1a6527f0c08c1569e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:35.242067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:35.243615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:35.258837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b962f4-4dd9-481f-a180-90081b220289 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:35.334617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:35.335339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.335622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.335899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] PATH_INFO: `/v3/projects/8a313413f234493f97f7072630033bed` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.337058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a313413f234493f97f7072630033bed)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:35.338972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:35.480380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a313413f234493f97f7072630033bed', 'request_id': 'req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:35.487050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a313413f234493f97f7072630033bed', 'request_id': 'req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:35.492827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a313413f234493f97f7072630033bed', 'request_id': 'req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:35.566009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] The token cache is being invalidate because project 8a313413f234493f97f7072630033bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:35.566316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:35.566934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d7bc88f0-8d41-4463-a4e0-e8b235ae7b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:35.568520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 945/1856] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:35 2022] DELETE /identity/v3/projects/8a313413f234493f97f7072630033bed => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:35.573501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.573999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.574090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.595525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:35.596917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:35.661301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 912/1857] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:35.669205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.669846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.670296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.698707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:35.700104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:35.709951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 946/1858] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:35.714465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:35.725399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437588c-46b8-407c-928e-6a14dc40816d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:35.731027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:35.732024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.732447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.732896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.733547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:35.733848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:35.736055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:35.748942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 913/1859] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:35.754013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:35.764067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab5f05-1f93-4c75-a67d-fe216f693c93 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:35.770022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:35.770663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.770943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.771220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.771895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:35.773814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:35.882172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 947/1860] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:35 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:35.887589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:35.905885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c86e-ef28-488f-a5c1-de299f1a9536 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:35.938223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:35.973182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:35.974474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:35.974474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:35.974474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:35.975005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:35.977026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.056049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 914/1861] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:35 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:36.060396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.081445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dd04-4222-4411-93c8-96f1079f7ae9 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.087128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.087861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.088176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.088450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.089225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.090813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.103462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 948/1862] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:36.111532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.119795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29cd2c-c7ce-47ef-a597-e189294a9cba admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.124576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.126368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.129551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.133678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:36.134287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.135056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.136956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.148649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 915/1863] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:36.153141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.168532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d2ae-c8ab-4fc7-b8eb-c64620d79408 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.175571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.176527 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.176957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.177230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] PATH_INFO: `/v3/projects/4261aa0b918b40f6b2690e2549ecf7d5/users/124758d7fdb447b494c02288495f0818/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.207363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4261aa0b918b40f6b2690e2549ecf7d5, user_id=124758d7fdb447b494c02288495f0818, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.211634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf2af7-f340-4c88-993f-3bb3a0e95c2c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.227687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.227687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.242581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6df04-d8a5-4020-a0f2-15388da020dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.247452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.248129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.248587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.248856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] PATH_INFO: `/v3/users/2d691267236e49888f4243f8fe2f7b44` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.250639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d691267236e49888f4243f8fe2f7b44)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.252787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.307761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 949/1864] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:36 2022] PUT /identity/v3/projects/4261aa0b918b40f6b2690e2549ecf7d5/users/124758d7fdb447b494c02288495f0818/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:36.319266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.319775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.320275 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.358280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] MFA Rules not processed for user `124758d7fdb447b494c02288495f0818`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:36.360899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.504960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 950/1865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:36.507055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d691267236e49888f4243f8fe2f7b44'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:36.527263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d691267236e49888f4243f8fe2f7b44'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:36.537910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d691267236e49888f4243f8fe2f7b44'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:36.539549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d691267236e49888f4243f8fe2f7b44'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:36.552673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.557263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.597084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-24117f78-94ad-47d1-83db-ed0de43f59d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d691267236e49888f4243f8fe2f7b44'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:36.606443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 916/1866] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:36 2022] DELETE /identity/v3/users/2d691267236e49888f4243f8fe2f7b44 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:36.612465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.613217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.613506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.658444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:36.659815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.683200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa088-c152-4b12-913a-f4b441de3eae None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.753428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.754241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.754354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.754762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.757239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.762120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 917/1867] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:36.774966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.776760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.864170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1e919-67e1-4ec5-8f84-81f2c5a0b87a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.864170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.864170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.864803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.866349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.870220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.871674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.883781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 951/1868] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:36.886622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.888353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa711d3-d066-4fb1-bb50-16f8669db3e7 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:36.901163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 918/1869] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:36.908630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:36.910870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:36.928056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e1fa-dd28-4732-958f-5d4bb92918f8 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:36.941519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:36.942184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:36.942494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:36.944339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] PATH_INFO: `/v3/users/124758d7fdb447b494c02288495f0818` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:36.952925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124758d7fdb447b494c02288495f0818)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:36.959401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:37.189220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124758d7fdb447b494c02288495f0818'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.201867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124758d7fdb447b494c02288495f0818'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.211012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124758d7fdb447b494c02288495f0818'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.249141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:37.277717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124758d7fdb447b494c02288495f0818'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.279028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124758d7fdb447b494c02288495f0818'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.287602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 952/1870] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:36 2022] DELETE /identity/v3/users/124758d7fdb447b494c02288495f0818 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:37.292285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:37.292580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:37.292861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:37.315121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:37.316412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:37.378679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 919/1871] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:37.388605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:37.390093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:37.456379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50132-8467-400f-9af7-00ae61ff0bf0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:37.462452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:37.463186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:37.463540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:37.463880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:37.474354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:37.475962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:37.487432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 953/1872] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:37.599493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:37.601777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:37.634443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1a2ed-b5a8-43be-bfd3-d99e531a3ea4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:37.642406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:37.643122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:37.645011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:37.645011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] PATH_INFO: `/v3/projects/f329531091994b6587cdc46c67eaf5ff` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:37.645245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f329531091994b6587cdc46c67eaf5ff)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:37.647365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:37.824046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f329531091994b6587cdc46c67eaf5ff', 'request_id': 'req-ccb24c88-478c-4539-a0dd-a6b79948d2f9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.905155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f329531091994b6587cdc46c67eaf5ff', 'request_id': 'req-ccb24c88-478c-4539-a0dd-a6b79948d2f9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.928370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f329531091994b6587cdc46c67eaf5ff', 'request_id': 'req-ccb24c88-478c-4539-a0dd-a6b79948d2f9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.941517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] The token cache is being invalidate because project f329531091994b6587cdc46c67eaf5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:37.942214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.943121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:37.948017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:37.951386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:37.958459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 920/1873] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:37 2022] DELETE /identity/v3/projects/f329531091994b6587cdc46c67eaf5ff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:37.966300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8196a5-a951-4a6f-b8a9-cb97a939f043 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:38.051174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:38.052356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.052901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.053190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] PATH_INFO: `/v3/users/83704280b0e4411ba1e6bfc2083456bf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.054983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83704280b0e4411ba1e6bfc2083456bf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:38.057265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:38.129707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:38.131789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:38.155256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24c88-478c-4539-a0dd-a6b79948d2f9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:38.160974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:38.161873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.162279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.162645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] PATH_INFO: `/v3/projects/4261aa0b918b40f6b2690e2549ecf7d5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.163911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4261aa0b918b40f6b2690e2549ecf7d5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:38.166795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:38.320167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83704280b0e4411ba1e6bfc2083456bf'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.321944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4261aa0b918b40f6b2690e2549ecf7d5', 'request_id': 'req-d4d3233f-9b58-422a-a902-0174d30b28b8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.353582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83704280b0e4411ba1e6bfc2083456bf'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.362383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83704280b0e4411ba1e6bfc2083456bf'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.399368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4261aa0b918b40f6b2690e2549ecf7d5', 'request_id': 'req-d4d3233f-9b58-422a-a902-0174d30b28b8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.406802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4261aa0b918b40f6b2690e2549ecf7d5', 'request_id': 'req-d4d3233f-9b58-422a-a902-0174d30b28b8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.417280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] The token cache is being invalidate because project 4261aa0b918b40f6b2690e2549ecf7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:38.417571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.418206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d4d3233f-9b58-422a-a902-0174d30b28b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.419850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 921/1874] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:38 2022] DELETE /identity/v3/projects/4261aa0b918b40f6b2690e2549ecf7d5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:38.425498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.425782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.426062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.447396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:38.448636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:38.476277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83704280b0e4411ba1e6bfc2083456bf'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.477277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-170cc688-ccdc-423b-b0d8-051bb93dd39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83704280b0e4411ba1e6bfc2083456bf'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:38.489363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 954/1875] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:37 2022] DELETE /identity/v3/users/83704280b0e4411ba1e6bfc2083456bf => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:38.539964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 922/1876] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:38.549928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.550247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.550662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.592459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:38.596005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:38.753689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 955/1877] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:38.755825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:38.770581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ee3bd-f83b-4e8b-93b6-9bb329851a12 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:38.787109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:38.787744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.788049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.788491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.789292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:38.789763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:38.791435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:38.808056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 923/1878] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:38.810899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:38.821431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf27a86-db9f-461b-bc42-ff3dedcfa0de None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:38.826750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:38.827365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:38.827635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:38.828242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:38.828949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:38.831041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:38.850751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:38.973222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 956/1879] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:38 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:38.977564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:38.992757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffd614-e72a-4819-865c-5ba03b41aa2b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.082088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.082944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.083229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.083512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.084202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.086239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.211003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.212846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:39.228636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f80ac-35cd-43e7-b49a-e9c9ab889e0e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.236015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.236980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.237355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.237756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] PATH_INFO: `/v3/projects/abc2b273dc8342e2b128ccb4e629ad05` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.242752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc2b273dc8342e2b128ccb4e629ad05)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.243052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 924/1880] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:38 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:39.244700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.247291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.258786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2043e-ffdc-454e-ab2f-3b046ac434be admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.271640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.272792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.273250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.273682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.274337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.276010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.287386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 925/1881] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:39.291878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.303442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5b72-d907-419b-94ec-923e93843944 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.309373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.309373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.309373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.309373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.309915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.311736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.322201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 926/1882] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:39.326206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.336447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01c67-4e3d-4054-9324-c2abcbc34a79 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.341021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.341653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.341935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.342212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] PATH_INFO: `/v3/projects/86a7b2b2427d48b697af0afd80ac373c/users/b6b996796bae4da0a721a4cbbf790abd/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.357752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a7b2b2427d48b697af0afd80ac373c, user_id=b6b996796bae4da0a721a4cbbf790abd, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.360664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d1f62-f467-497b-9b18-a421ab6724fe admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.383921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc2b273dc8342e2b128ccb4e629ad05', 'request_id': 'req-62fdc6b9-c93b-459c-af64-80529c1a39ac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:39.391711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc2b273dc8342e2b128ccb4e629ad05', 'request_id': 'req-62fdc6b9-c93b-459c-af64-80529c1a39ac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:39.398200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc2b273dc8342e2b128ccb4e629ad05', 'request_id': 'req-62fdc6b9-c93b-459c-af64-80529c1a39ac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:39.479590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] The token cache is being invalidate because project abc2b273dc8342e2b128ccb4e629ad05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:39.480298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:39.482542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fdc6b9-c93b-459c-af64-80529c1a39ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:39.482542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 957/1883] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:39 2022] DELETE /identity/v3/projects/abc2b273dc8342e2b128ccb4e629ad05 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:39.482721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 927/1884] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:39 2022] PUT /identity/v3/projects/86a7b2b2427d48b697af0afd80ac373c/users/b6b996796bae4da0a721a4cbbf790abd/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:39.487535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b51ac-fe97-499a-ac99-d75c13c3239a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.488453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b51ac-fe97-499a-ac99-d75c13c3239a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.488453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b51ac-fe97-499a-ac99-d75c13c3239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.492900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.493181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.493451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.520291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fb8b51ac-fe97-499a-ac99-d75c13c3239a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:39.521556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fb8b51ac-fe97-499a-ac99-d75c13c3239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:39.545050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] MFA Rules not processed for user `b6b996796bae4da0a721a4cbbf790abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:39.546278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:39.582452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 958/1885] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:39.590556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.590846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.591128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.611151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:39.612302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:39.613063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 928/1886] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:39.617607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.618865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:39.621060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 959/1887] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:39.629059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.634086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daed4d-4dae-4ce5-b39e-d1e2650ecf66 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.637983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828988-a066-4f2b-aa09-9e8369cff816 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.639032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.639645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.639925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.640237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.641490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.643354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.643479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.644153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.654705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.654705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.654705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:39.654705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.654705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.659825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 960/1888] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:10:39.664198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.674562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ae66-213d-4f1c-8617-b6d315b515ae admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.679145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.679752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.680056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.680330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.681107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.683059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.747366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 929/1889] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:39.748437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.764871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 961/1890] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:39.766383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.824983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:39.838440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b027a36-9b4b-41fa-b887-35b91574c52f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.844638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.845339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.846000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.846352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.846462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad721-77ce-45b9-b0ac-476da4999798 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.848605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.851278 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.852052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.852320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.852593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.853215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.855465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.862080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.943460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 962/1891] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:39.944567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.958248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b2776-efd9-4f13-a9b7-c657fd19b2d0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.965165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.966149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.966665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.967081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.970086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 930/1892] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:39 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:39.970202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.970738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:39.973355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.985072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e3d3-ed1e-42f4-a914-7ba8b57acccc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:39.985718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 963/1893] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:39.989391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:39.991632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:39.999035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:39.999035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:39.999035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:39.999035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:39.999035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.000935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0481b-2f9e-4635-8b71-15879facfdb3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.009151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.009562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 931/1894] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:40.012849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.013888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.014291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.014668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.015905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.018016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.025901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fdd7-0504-45b6-a7d9-5b48349b1139 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.030665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.031305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.031583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.031856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.032574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.032952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 964/1895] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:40.034629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.037149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.049169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d43da3-deeb-401a-bb6b-e52233f78533 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.054349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 932/1896] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:40.056372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.056553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.056949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.057298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] PATH_INFO: `/v3/projects/f09d69b13fce4f58b909edfb9743fc66/users/e2634f6b7aaf4e53be9bedcf8695766b/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.060897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.078625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09d69b13fce4f58b909edfb9743fc66, user_id=e2634f6b7aaf4e53be9bedcf8695766b, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.081312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508413-7f08-40de-b540-3c87befbc902 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.081661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.088230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.088918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.093271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.093271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] PATH_INFO: `/v3/projects/de930e6a337f4198805dc970c45bbe37/users/a448a28498384829a77dd076ebc8de31/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.105903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de930e6a337f4198805dc970c45bbe37, user_id=a448a28498384829a77dd076ebc8de31, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.108956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a8c0-0061-4b4c-bbaa-9051c880c89b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.182877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 965/1897] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:40 2022] PUT /identity/v3/projects/f09d69b13fce4f58b909edfb9743fc66/users/e2634f6b7aaf4e53be9bedcf8695766b/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:40.183809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.189406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.207965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 933/1898] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:40 2022] PUT /identity/v3/projects/de930e6a337f4198805dc970c45bbe37/users/a448a28498384829a77dd076ebc8de31/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:40.209397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152b80-b816-4157-b6f2-58bc977731a5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.209735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152b80-b816-4157-b6f2-58bc977731a5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.210089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152b80-b816-4157-b6f2-58bc977731a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.245798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-01152b80-b816-4157-b6f2-58bc977731a5 None None] MFA Rules not processed for user `e2634f6b7aaf4e53be9bedcf8695766b`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:40.247303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-01152b80-b816-4157-b6f2-58bc977731a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.283644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8536-3f38-4b98-84eb-f40a5df5f3e6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.337123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 934/1899] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:40.349122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.349122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.349323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.364600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.365334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.365693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.366055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] PATH_INFO: `/v3/users/2b3813d831354b2fac93a99d80b62401` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.367281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3813d831354b2fac93a99d80b62401)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.369638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.380060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] MFA Rules not processed for user `a448a28498384829a77dd076ebc8de31`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:40.381187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.482230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 935/1900] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:40.483411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.485451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.569702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa2313-b75d-4e8e-829e-f8a1f23c2bb2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.576309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.576309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.576309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.576309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.587439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3813d831354b2fac93a99d80b62401'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:40.592787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.595374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.611276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3813d831354b2fac93a99d80b62401'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:40.612893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 936/1901] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:40.614645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.625453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3813d831354b2fac93a99d80b62401'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:40.639946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af997-ff4c-4a99-8772-7e897c7753ed service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.645403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.646126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.647774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.647774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.647774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.649718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a18275-7398-45c7-aac6-97535f6b8daf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.710513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3813d831354b2fac93a99d80b62401'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:40.711205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3813d831354b2fac93a99d80b62401'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:40.721924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 966/1902] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:40 2022] DELETE /identity/v3/users/2b3813d831354b2fac93a99d80b62401 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:40.723125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.724794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.752368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 937/1903] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:40 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:40.753919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.754309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.754717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.785831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:40.789083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.822657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61896-5c63-4a20-bf8e-7e79c48ebde6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.884494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 938/1904] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:40.885458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:40.887477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:40.892726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.893702 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.893987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.894261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] PATH_INFO: `/v3/users/e2634f6b7aaf4e53be9bedcf8695766b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.895445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2634f6b7aaf4e53be9bedcf8695766b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.897414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.902968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7394800-67b3-494e-85fb-c7b9322b9786 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:40.907999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:40.908711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:40.909051 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:40.909702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:40.910122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:40.912316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:40.940155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:41.040120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:41.046224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 939/1905] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:40 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:41.049916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.073350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.138010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2634f6b7aaf4e53be9bedcf8695766b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:41.151618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2634f6b7aaf4e53be9bedcf8695766b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:41.160201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2634f6b7aaf4e53be9bedcf8695766b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:41.166985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eb4c7-55a9-419c-9eeb-d4930cb5b68c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.171562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.172527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.172955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.173210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.184447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.186727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.206942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 940/1906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:41.208568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.220526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff515f-54cf-4f50-bfd7-291da1d5f728 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.226747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.227526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.227871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.228238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.229025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.231191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.245767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 941/1907] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:41.253897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.279508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2634f6b7aaf4e53be9bedcf8695766b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:41.282401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4e353-74e1-4f00-aead-e744843d2c4f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.282507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-17a5a34c-4a17-4b2a-a3cb-b1e504c4f864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2634f6b7aaf4e53be9bedcf8695766b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:41.288840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.289774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 967/1908] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:40 2022] DELETE /identity/v3/users/e2634f6b7aaf4e53be9bedcf8695766b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:41.292537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.292728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.293160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] PATH_INFO: `/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d/users/6e1dc88c02b048de9565de583de63a49/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.294709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.295092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.296266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.319493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:41.321456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.322749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c85e01ee074f55bb48e3c468d2e08d, user_id=6e1dc88c02b048de9565de583de63a49, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.326506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.385318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 968/1909] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:41.395381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.396812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.457420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e5b71-3750-4452-8bac-d2ae144188e8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.461818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.462595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.462708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.462978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.467205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 942/1910] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:41 2022] PUT /identity/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d/users/6e1dc88c02b048de9565de583de63a49/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:41.471037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.472764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.478101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.480642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.518221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 969/1911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:41.545184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:41.568079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c65b7-1168-4439-9ef0-9736c5821a50 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.578733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.580722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.581092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.581384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.582206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.584831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af78d3-4a89-464e-ab3c-ca5cb2c5a8b6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.603759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 943/1912] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:41.607294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.618554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232a187-c28b-411b-9b6c-5ba79a4a681b service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.644182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.645450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.646162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.647263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] PATH_INFO: `/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d/users/6e1dc88c02b048de9565de583de63a49/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.654479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c85e01ee074f55bb48e3c468d2e08d, user_id=6e1dc88c02b048de9565de583de63a49, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:41.658390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:41.688200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 970/1913] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:41 2022] PUT /identity/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d/users/6e1dc88c02b048de9565de583de63a49/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:41.698739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.699161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.699596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.744527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] MFA Rules not processed for user `6e1dc88c02b048de9565de583de63a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:41.745768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.834283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 944/1914] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:41.835417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:41.837124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.915190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96a4-989e-492e-8e03-d65a7946ef10 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:41.918835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:41.919635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:41.920051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:41.920428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:41.922835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:41.998247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:42.000725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:42.012160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 971/1915] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:42.354724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:42.402588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:42.404111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:42.530710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cba51-589c-4a6d-8008-9a71ccb6521e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:42.551202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:42.553868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:42.554165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:42.554746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] PATH_INFO: `/v3/projects/1988779508254f4086cd10e18e78b162` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:42.556196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1988779508254f4086cd10e18e78b162)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:42.559328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:42.703488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1988779508254f4086cd10e18e78b162', 'request_id': 'req-01d65307-6734-4189-8dec-b2c8d4b46fa5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:42.727707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:42.834156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1988779508254f4086cd10e18e78b162', 'request_id': 'req-01d65307-6734-4189-8dec-b2c8d4b46fa5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:42.848008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:42.856574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1988779508254f4086cd10e18e78b162', 'request_id': 'req-01d65307-6734-4189-8dec-b2c8d4b46fa5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:42.892179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] The token cache is being invalidate because project 1988779508254f4086cd10e18e78b162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:42.892673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:42.893472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:42.898983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 945/1916] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:42 2022] DELETE /identity/v3/projects/1988779508254f4086cd10e18e78b162 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:42.900281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:42.913882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75ca46-dd37-4b87-80ef-3cf5b7b2e3cb service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:43.035421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:43.038662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.038956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.039232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] PATH_INFO: `/v3/users/292df51f9a1245b88528f51ee2560d08` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.040552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292df51f9a1245b88528f51ee2560d08)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:43.044804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:43.169835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:43.171363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:43.185970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65307-6734-4189-8dec-b2c8d4b46fa5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:43.191154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:43.191913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.192321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.192723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] PATH_INFO: `/v3/projects/f09d69b13fce4f58b909edfb9743fc66` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.194315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09d69b13fce4f58b909edfb9743fc66)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:43.197312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:43.264905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292df51f9a1245b88528f51ee2560d08'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.287645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292df51f9a1245b88528f51ee2560d08'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.299170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292df51f9a1245b88528f51ee2560d08'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.317771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09d69b13fce4f58b909edfb9743fc66', 'request_id': 'req-50b6be27-2606-4868-8ad9-5766a739cba5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.374197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292df51f9a1245b88528f51ee2560d08'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.374962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bd4196c2-b2e2-4578-874a-c6743f1aca57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292df51f9a1245b88528f51ee2560d08'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.382267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 972/1917] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:42 2022] DELETE /identity/v3/users/292df51f9a1245b88528f51ee2560d08 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:43.487913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09d69b13fce4f58b909edfb9743fc66', 'request_id': 'req-50b6be27-2606-4868-8ad9-5766a739cba5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.504243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09d69b13fce4f58b909edfb9743fc66', 'request_id': 'req-50b6be27-2606-4868-8ad9-5766a739cba5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.521308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] The token cache is being invalidate because project f09d69b13fce4f58b909edfb9743fc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:43.521599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.522254 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50b6be27-2606-4868-8ad9-5766a739cba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:43.535938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 946/1918] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:43 2022] DELETE /identity/v3/projects/f09d69b13fce4f58b909edfb9743fc66 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:43.536572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.536572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.536572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.560686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:43.561989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:43.663968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 973/1919] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:43.666368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.666820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.667048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.703932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:43.705804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:43.715411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 947/1920] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:43.721950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:43.759565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f77f-a331-4d09-bfe9-9b9118366467 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:43.776828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:43.777626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.778006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.778372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.779135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:43.779533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:43.782433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:43.800308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 974/1921] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:10:43.803162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:43.814437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e0c25-8f77-4013-a112-6c1805e5c380 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:43.819674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:43.820413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:43.820644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:43.820917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:43.821618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:43.823594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:43.951579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 948/1922] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:43 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:43.956487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:43.979753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cd32-cb69-4f2e-ad8a-1b950b96e69e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:43.993425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:43.997727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.107242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.108429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.109053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.109704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.111320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.114671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.191213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015219da-c4e1-46ec-b1c4-87cabe1a9dae admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.196724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.197529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.197682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.197903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] PATH_INFO: `/v3/projects/f0bfcc99440241e3b14a782dc904878a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.199032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bfcc99440241e3b14a782dc904878a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.200990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.280036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 975/1923] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:43 2022] POST /identity/v3/users => generated 288 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:44.290616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.302915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8713e45-e860-44c9-85e6-924f738b091d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.328841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.331752 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.337227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.337227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.337227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.337989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.338707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bfcc99440241e3b14a782dc904878a', 'request_id': 'req-2edb6bb2-9531-4926-a122-45e1d31deaf1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:44.362326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 976/1924] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:44.369290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.393901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7937c-e941-48df-a95d-ab5221819f2f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.456821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bfcc99440241e3b14a782dc904878a', 'request_id': 'req-2edb6bb2-9531-4926-a122-45e1d31deaf1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:44.464290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bfcc99440241e3b14a782dc904878a', 'request_id': 'req-2edb6bb2-9531-4926-a122-45e1d31deaf1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:44.475817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.476449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.476724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.476998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.477631 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.478004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] The token cache is being invalidate because project f0bfcc99440241e3b14a782dc904878a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:44.478340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:44.479084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:44.479465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8545e-047d-4226-b64c-c44802be962c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.485741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 949/1925] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:43 2022] DELETE /identity/v3/projects/f0bfcc99440241e3b14a782dc904878a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:44.485741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.485741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.493519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 977/1926] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:44.493519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.493519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.493803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.516638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:44.517956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.527011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 978/1927] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:44.527842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.533332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.547288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a3de7-50cc-4a59-918c-bf3d80c6803c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.549455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6bb2-9531-4926-a122-45e1d31deaf1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.551678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.552381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.552624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.552897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.553270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.554051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.554329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.554653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] PATH_INFO: `/v3/projects/641b9b53d1be4dfb90aa46d18411955a/users/4c5841fc4b774c01bce07d8e7d5312d1/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.555221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.570968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641b9b53d1be4dfb90aa46d18411955a, user_id=4c5841fc4b774c01bce07d8e7d5312d1, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.573746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493553c-96e5-4812-9ca3-8aa15e079530 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.619374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.620846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3767f-fc46-4d06-846b-50298a7b80ce service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.630706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 950/1928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:44.631953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.632234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.632509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.657084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:44.659904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 979/1929] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:44 2022] PUT /identity/v3/projects/641b9b53d1be4dfb90aa46d18411955a/users/4c5841fc4b774c01bce07d8e7d5312d1/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:44.661551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:44.662776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.670402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.670685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.670956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.712644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] MFA Rules not processed for user `4c5841fc4b774c01bce07d8e7d5312d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:44.715341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.737811 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:44.747166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 951/1930] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:44.748209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.758226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fae37-dc9c-4279-b82a-e6b635a2830b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.763823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.764978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.764978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.765260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.766282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:44.766661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.772808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.780854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 952/1931] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:44.785557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.795954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b464-bc7e-45a2-84b8-947271fd1850 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.801344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 980/1932] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:44.803491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.806266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.806266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.806266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:44.806266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:44.810212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:44.816754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.818273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:44.918970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 953/1933] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:44 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:44.923649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:44.936262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942718f-da42-46ef-80f2-e5ee22620d44 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:44.996016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:44.997627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:44.998211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:44.998638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.097029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806e444-625e-4a89-988b-44edfeec3286 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:45.108195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.110003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:45.111009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.112952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.113263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.114505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.117156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.119884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.162828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 981/1934] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:45.293914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 954/1935] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:44 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:45.299303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:45.318742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d27f-9314-45e6-bbc3-04448aaf6fef service glance] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:45.329284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:45.330051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.330393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.330674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.331309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.333091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.344563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 982/1936] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:45.348786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:45.360485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934d5c-c54c-4540-a908-6c0f2c5a8c05 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:45.365934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:45.366883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.367352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.367757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.368590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.370566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdf6c3-3f2d-45b5-bd47-95e3148a28b3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.383800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 955/1937] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:45.388231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:45.398809 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302466c-314d-4967-baf8-ba7ce064fb17 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:45.404126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:45.405981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.406312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.406592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] PATH_INFO: `/v3/projects/a0de23ccb02144ae96d536a46f60703d/users/6216b5ab6b58426f801756c44bb0f602/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.424759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0de23ccb02144ae96d536a46f60703d, user_id=6216b5ab6b58426f801756c44bb0f602, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.427710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.519687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 983/1938] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:45 2022] PUT /identity/v3/projects/a0de23ccb02144ae96d536a46f60703d/users/6216b5ab6b58426f801756c44bb0f602/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:45.522850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.523495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.523780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.565117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] MFA Rules not processed for user `6216b5ab6b58426f801756c44bb0f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:45.566241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:45.663469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 956/1939] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:45.668184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:45.750034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b27eef-e1ae-4265-83dc-881508ec8796 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:45.761824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:45.762903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:45.763380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:45.763949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:45.768532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:45.768532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:45.894863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 984/1940] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:45 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:45.899000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:45.914806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e775b-708c-44a6-a8ad-3fcbae9ee24c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:46.011275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:46.012433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.013749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.013749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.014585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:46.016766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:46.168369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 957/1941] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:45 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:46.169770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:46.181918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3693d-7dd5-4d43-999c-3236e191965a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:46.186829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:46.193259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.193259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.193259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.193259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:46.194353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:46.206386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 985/1942] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:46.210786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:46.221422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ccf4f-09d5-4b4b-a95b-ca6634ed18f3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:46.226770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:46.227490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.227799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.228113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] PATH_INFO: `/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e/users/0bcc39880bdf401b988046355ea832ee/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.247286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9682b216b840cab6a3e9a0d7f9201e, user_id=0bcc39880bdf401b988046355ea832ee, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:46.251201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:46.354426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 958/1943] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:46 2022] PUT /identity/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e/users/0bcc39880bdf401b988046355ea832ee/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:46.354658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:46.363221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93139cb-3b0f-401e-9c21-f58f28d2ee7f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:46.547535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:46.548804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.549081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.550422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.551161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:46.556217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2507-cad8-483c-a431-5bab506821a9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:46.574176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:46.613049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 986/1944] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:46.618143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:46.641417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07768-d595-4e3a-acc9-d2ee64870e87 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:46.653886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:46.661036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:46.663594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.664166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.666815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] PATH_INFO: `/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e/users/0bcc39880bdf401b988046355ea832ee/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.667909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9682b216b840cab6a3e9a0d7f9201e, user_id=0bcc39880bdf401b988046355ea832ee, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:46.671296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:46.776027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 959/1945] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:46 2022] PUT /identity/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e/users/0bcc39880bdf401b988046355ea832ee/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:46.795349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:46.795349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:46.795349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:46.860557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] MFA Rules not processed for user `0bcc39880bdf401b988046355ea832ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:46.864965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:47.038266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:47.064351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 987/1946] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:47.150648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42061e1-6e4f-4b81-9324-a177e95d988a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:47.166248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:47.167211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:47.167753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:47.168302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:47.170839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:47.298803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:47.300431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:47.315275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 960/1947] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:47.382781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:47.384916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:47.413343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580660c8-afc7-4e08-bb9b-6620cc742a0c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:47.421364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:47.423966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:47.424548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:47.425099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:47.508427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:47.510346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:47.538371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 988/1948] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:48.727829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:48.948767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:49.464795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:49.478058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf75c0-27b7-4529-95cc-cb5a74b3c22f service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:49.487881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:49.488564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:49.488847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:49.489149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:49.509037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:49.510642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246396a-a112-48cb-b9c3-94bd7be80219 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:49.522660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 961/1949] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:50.674384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:50.857135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:51.765125 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:52.219813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:52.468355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:52.590356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:52.591960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:52.657384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88611da-d0bf-463f-863e-8cadbcee0487 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:52.663212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:52.663864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:52.664178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:52.664458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] PATH_INFO: `/v3/users/b6b996796bae4da0a721a4cbbf790abd` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:52.665597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b996796bae4da0a721a4cbbf790abd)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:52.667521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:52.844570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b996796bae4da0a721a4cbbf790abd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:52.861424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b996796bae4da0a721a4cbbf790abd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:52.869198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b996796bae4da0a721a4cbbf790abd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:52.927596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b996796bae4da0a721a4cbbf790abd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:52.928306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b996796bae4da0a721a4cbbf790abd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:52.934767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 989/1950] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:52 2022] DELETE /identity/v3/users/b6b996796bae4da0a721a4cbbf790abd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:52.939845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:52.940377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:52.940479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:52.959904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:52.960610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:52.961881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:53.036730 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 962/1951] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:53.051124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:53.052845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:53.110447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd0fd-4232-415b-a487-f2bef63c97f3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:53.114000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:53.114668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:53.114948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:53.115219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:53.124383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:53.125905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:53.135633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 990/1952] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:53.211795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:53.563918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:53.563918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:53.577029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f5d4-17f4-4983-8ab5-8295ac6c6e0b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:53.582334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:53.583010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:53.583323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:53.583600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] PATH_INFO: `/v3/projects/86a7b2b2427d48b697af0afd80ac373c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:53.584910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a7b2b2427d48b697af0afd80ac373c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:53.586792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:53.715721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a7b2b2427d48b697af0afd80ac373c', 'request_id': 'req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:53.778511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a7b2b2427d48b697af0afd80ac373c', 'request_id': 'req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:53.785935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a7b2b2427d48b697af0afd80ac373c', 'request_id': 'req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:53.797956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] The token cache is being invalidate because project 86a7b2b2427d48b697af0afd80ac373c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:53.798255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:53.799229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:53.800768 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 963/1953] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:53 2022] DELETE /identity/v3/projects/86a7b2b2427d48b697af0afd80ac373c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:53.804781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:53.815906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d8f4-d5f9-4bda-a207-195064b890ed service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:53.841980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:53.873913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:53.877080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:53.877728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:53.878011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:53.878290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] PATH_INFO: `/v3/users/a448a28498384829a77dd076ebc8de31` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:53.879437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a448a28498384829a77dd076ebc8de31)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:53.881494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:54.083115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:54.084565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:54.106920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a448a28498384829a77dd076ebc8de31'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.108099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaef120-5e3a-4ee8-ac3f-0ba95108bddd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:54.114578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:54.115361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:54.115816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:54.116325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] PATH_INFO: `/v3/users/6216b5ab6b58426f801756c44bb0f602` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:54.118214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6216b5ab6b58426f801756c44bb0f602)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:54.120360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a448a28498384829a77dd076ebc8de31'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.121798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:54.123245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.130766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a448a28498384829a77dd076ebc8de31'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.230279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a448a28498384829a77dd076ebc8de31'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.231037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0bf8c226-476c-4d14-ac29-b8bb8112ca8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a448a28498384829a77dd076ebc8de31'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.239126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 991/1954] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:53 2022] DELETE /identity/v3/users/a448a28498384829a77dd076ebc8de31 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:54.316827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.353475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6216b5ab6b58426f801756c44bb0f602'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.374190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6216b5ab6b58426f801756c44bb0f602'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.384119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6216b5ab6b58426f801756c44bb0f602'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.385605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6216b5ab6b58426f801756c44bb0f602'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.391190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.528366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6216b5ab6b58426f801756c44bb0f602'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:54.539865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 964/1955] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:54 2022] DELETE /identity/v3/users/6216b5ab6b58426f801756c44bb0f602 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:54.542192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:54.542563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:54.542900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:54.575157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:54.582421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:54.601652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.625380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.646841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 992/1956] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:54.653850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:54.655468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:54.699959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:54.727535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d85e-ca5c-4d23-bccd-d2c359e86dd3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:54.731467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:54.732122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:54.732401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:54.732670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:54.742770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:54.744241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:54.755137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 965/1957] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:54.844205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:54.844205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:54.854138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304bb30-5451-416f-aa1e-14f2d715d62b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:54.861763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:54.862591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:54.863020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:54.863394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] PATH_INFO: `/v3/projects/de930e6a337f4198805dc970c45bbe37` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:54.865537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de930e6a337f4198805dc970c45bbe37)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:54.867684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:55.032237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de930e6a337f4198805dc970c45bbe37', 'request_id': 'req-bf01b726-2c49-4a09-93e6-30d6444c3f16'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.036126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:55.041535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de930e6a337f4198805dc970c45bbe37', 'request_id': 'req-bf01b726-2c49-4a09-93e6-30d6444c3f16'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.051941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de930e6a337f4198805dc970c45bbe37', 'request_id': 'req-bf01b726-2c49-4a09-93e6-30d6444c3f16'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.178539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] The token cache is being invalidate because project de930e6a337f4198805dc970c45bbe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:55.178836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.179561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.185333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 993/1958] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:54 2022] DELETE /identity/v3/projects/de930e6a337f4198805dc970c45bbe37 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:55.189682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:55.201819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6644f33-10d2-43e1-aa28-cb15093b4572 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:55.213818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:55.269441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:55.270105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:55.270387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:55.270659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] PATH_INFO: `/v3/users/6e1dc88c02b048de9565de583de63a49` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:55.271782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1dc88c02b048de9565de583de63a49)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:55.273739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:55.595564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:55.595564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:55.595564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b726-2c49-4a09-93e6-30d6444c3f16 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:55.596655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:55.596655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:55.596655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:55.596655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] PATH_INFO: `/v3/projects/a0de23ccb02144ae96d536a46f60703d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:55.597246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0de23ccb02144ae96d536a46f60703d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:55.597246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:55.675882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1dc88c02b048de9565de583de63a49'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.676159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0de23ccb02144ae96d536a46f60703d', 'request_id': 'req-d86ebec2-9668-4f67-9154-73ee8deefd02'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.682796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0de23ccb02144ae96d536a46f60703d', 'request_id': 'req-d86ebec2-9668-4f67-9154-73ee8deefd02'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.689902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0de23ccb02144ae96d536a46f60703d', 'request_id': 'req-d86ebec2-9668-4f67-9154-73ee8deefd02'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.694344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1dc88c02b048de9565de583de63a49'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.701404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1dc88c02b048de9565de583de63a49'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.708721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1dc88c02b048de9565de583de63a49'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.793001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] The token cache is being invalidate because project a0de23ccb02144ae96d536a46f60703d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:55.793341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.793986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.795586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 994/1959] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:55 2022] DELETE /identity/v3/projects/a0de23ccb02144ae96d536a46f60703d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:55.800338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:55.801757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:55.867361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ebec2-9668-4f67-9154-73ee8deefd02 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:55.872284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:55.873006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:55.873289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:55.873565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] PATH_INFO: `/v3/users/0bcc39880bdf401b988046355ea832ee` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:55.875416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcc39880bdf401b988046355ea832ee)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:55.877387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:55.884793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1dc88c02b048de9565de583de63a49'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:55.892087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 966/1960] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:55 2022] DELETE /identity/v3/users/6e1dc88c02b048de9565de583de63a49 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:55.982465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:56.048783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcc39880bdf401b988046355ea832ee'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.064975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcc39880bdf401b988046355ea832ee'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.074245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcc39880bdf401b988046355ea832ee'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.181202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcc39880bdf401b988046355ea832ee'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.181202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcc39880bdf401b988046355ea832ee'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.193105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 995/1961] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:10:55 2022] DELETE /identity/v3/users/0bcc39880bdf401b988046355ea832ee => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:56.340736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:56.342718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:56.427650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a58f8-94a6-41b9-bb55-d37c6dfed56c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:56.471126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:56.496872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:56.517550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:56.517550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:56.517550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] PATH_INFO: `/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:56.517550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c85e01ee074f55bb48e3c468d2e08d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:56.517550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:56.711004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c85e01ee074f55bb48e3c468d2e08d', 'request_id': 'req-79e28bfd-3aeb-4624-8491-030cfccd8df7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.756742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:56.758370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:56.775464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f58d-08ac-45cd-811c-5b4a51980042 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:56.790762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c85e01ee074f55bb48e3c468d2e08d', 'request_id': 'req-79e28bfd-3aeb-4624-8491-030cfccd8df7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.799759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c85e01ee074f55bb48e3c468d2e08d', 'request_id': 'req-79e28bfd-3aeb-4624-8491-030cfccd8df7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.813207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] The token cache is being invalidate because project b2c85e01ee074f55bb48e3c468d2e08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:56.813804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.814687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-79e28bfd-3aeb-4624-8491-030cfccd8df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.817270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 967/1962] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:56 2022] DELETE /identity/v3/projects/b2c85e01ee074f55bb48e3c468d2e08d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:56.827857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9d33-aa5d-4847-8d21-9866ca98c87e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:56.828263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9d33-aa5d-4847-8d21-9866ca98c87e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:56.828639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9d33-aa5d-4847-8d21-9866ca98c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:56.854982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-583d9d33-aa5d-4847-8d21-9866ca98c87e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:56.859861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:56.860663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:56.860950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:56.861226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] PATH_INFO: `/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:56.862439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9682b216b840cab6a3e9a0d7f9201e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:56.864582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:56.866591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-583d9d33-aa5d-4847-8d21-9866ca98c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:56.883929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 968/1963] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:56.892177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:56.892467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:56.892808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:56.923594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:56.924882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:56.934999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 969/1964] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:56.939902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:56.954694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958131-8393-4518-b0bc-196307b4c90f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:56.960538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:56.961209 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:56.961554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:56.961883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:56.962949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:56.963362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:56.976016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:56.992024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 970/1965] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:56.992172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9682b216b840cab6a3e9a0d7f9201e', 'request_id': 'req-14898f9d-f610-4845-9008-c98186258d05'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:56.995395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:56.997724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9682b216b840cab6a3e9a0d7f9201e', 'request_id': 'req-14898f9d-f610-4845-9008-c98186258d05'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:57.004150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9682b216b840cab6a3e9a0d7f9201e', 'request_id': 'req-14898f9d-f610-4845-9008-c98186258d05'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:57.011415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176a6de-82e7-4b5a-8324-acc028cc2294 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.065681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.066308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.066601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.066868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.067542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.070523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.098771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] The token cache is being invalidate because project 9d9682b216b840cab6a3e9a0d7f9201e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:10:57.106103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:57.106103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-14898f9d-f610-4845-9008-c98186258d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:10:57.106103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 996/1966] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:10:56 2022] DELETE /identity/v3/projects/9d9682b216b840cab6a3e9a0d7f9201e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:57.106550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553fb7-7aaf-4e9b-b51c-e78967847d48 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.106843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553fb7-7aaf-4e9b-b51c-e78967847d48 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.107131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553fb7-7aaf-4e9b-b51c-e78967847d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.128029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-53553fb7-7aaf-4e9b-b51c-e78967847d48 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:57.132066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-53553fb7-7aaf-4e9b-b51c-e78967847d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:57.137396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 997/1967] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:57.145167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.145450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.145718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.166327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:57.167544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:57.176466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 998/1968] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:10:57.180844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.186636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:57.191420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f4d-c40d-4c73-abde-13afd52a2c8c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.196341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.196673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 971/1969] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:56 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:57.196961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.197398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.197675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.198330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:10:57.198643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.200262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.201145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.203421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:57.218297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 999/1970] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:10:57.222421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.235536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab690-3688-48bc-8795-ff7ccd2be63c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.244441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:57.288622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febd4f-7251-476e-87b6-d67d6ef412ef admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.293666 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.294278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.294557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.294834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.295470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.298772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.314753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.315366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.315642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.315913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.316571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.318465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.410055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 972/1971] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:57.411232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.422381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cfbcf-913c-4854-baf6-7d11c2590aac admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.428829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.429482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.429880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.430458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.431157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.433049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.444202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1000/1972] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/projects => generated 391 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:10:57.447683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 973/1973] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:57.448778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.449152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.461397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094447-eaac-480d-ab5c-ae88685328e8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.536280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.536903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.537179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.537449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.537675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc900774-c396-46fe-87d5-166809a8a8af admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.538102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.539813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.542916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.543591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.543959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.544266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.544897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.547353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.551458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 974/1974] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:57.555459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.572124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001102-cd8c-425f-aac5-29047f33b363 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.577019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.578242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.578827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.579103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] PATH_INFO: `/v3/projects/b996d13725c04ab3be768230fafe5091/users/73c762a4b57c4458a03d5fd744489f73/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.597995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b996d13725c04ab3be768230fafe5091, user_id=73c762a4b57c4458a03d5fd744489f73, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.600774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73920a-6ecd-4f0e-92c6-a43c12dd02d9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.644604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1001/1975] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:57.649767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.660685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f74c9-ccf8-4e3f-8548-67153bc255b7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.665360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.665998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.666277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.666545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.667349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.668939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.680139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 975/1976] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:57 2022] PUT /identity/v3/projects/b996d13725c04ab3be768230fafe5091/users/73c762a4b57c4458a03d5fd744489f73/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:57.686298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.686663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.686838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.692338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1002/1977] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:57.701353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.711845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56edd-4bdf-4b28-935b-5fe2c20bf2ed admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.718419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] MFA Rules not processed for user `73c762a4b57c4458a03d5fd744489f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:57.719645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:57.772138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:57.780661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.781916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.782319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.788509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.789084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.790930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.796104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 976/1978] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:57.808557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.810741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:57.811730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1003/1979] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:10:57.813294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:57.830808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043b78f-88a7-4552-a5dd-4798699201a7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.831082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:57.833709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.834393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.834683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.834957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] PATH_INFO: `/v3/projects/661687e7cab043f2b1e7b1500f562fa1/users/e66658ff58974f84adcef8b7e28ca315/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.851730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=661687e7cab043f2b1e7b1500f562fa1, user_id=e66658ff58974f84adcef8b7e28ca315, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.854452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.891124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f67dc3-7a9e-4a75-b3f3-d6d9f8b233a5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:57.894795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:57.895437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.895717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.896003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.904502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:57.906990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b529-45cd-4f14-a897-7126a294e6f0 service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:57.916984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 977/1980] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:10:57.940040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1004/1981] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:57 2022] PUT /identity/v3/projects/661687e7cab043f2b1e7b1500f562fa1/users/e66658ff58974f84adcef8b7e28ca315/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:57.950196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:57.950488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:57.950776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:57.979941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] MFA Rules not processed for user `e66658ff58974f84adcef8b7e28ca315`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:57.981411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:58.067963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 978/1982] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:58.072394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.154604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ae4f5-7276-44a4-87f7-d0784f52d67c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.160633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.161013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.161295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.161629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.162241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.164893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.253103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1005/1983] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:10:58 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:58.257308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.268838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c861a38-b401-4b46-9e18-e97c6453e429 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.329531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.330672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.330672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.330672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.331519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.333338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.445935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 979/1984] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:10:58 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:10:58.447525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.459588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0785a-de5f-42ff-91cb-0b29587a283a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.464293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.464896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.465181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.465457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.466097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.467808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.478389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1006/1985] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:58.482989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.493068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57b3a-0ba4-4a95-9bb5-f8520af54fff admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.497654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.498296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.498574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.498845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] PATH_INFO: `/v3/projects/78b943428ccd412b8b457e1f57f194c0/users/4e280d17bdb54b028970f63f9ded6cac/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.514691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b943428ccd412b8b457e1f57f194c0, user_id=4e280d17bdb54b028970f63f9ded6cac, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.518082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.622732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 980/1986] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:58 2022] PUT /identity/v3/projects/78b943428ccd412b8b457e1f57f194c0/users/4e280d17bdb54b028970f63f9ded6cac/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:10:58.627764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.637661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fad1-ab82-4af6-b547-535b7229cd83 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.701991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.702660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.702952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.703254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.703959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.705606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670ab9-4582-46a0-9aa1-fce0052274fd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.715327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1007/1987] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:10:58.720540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.727524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:58.731016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ec96-e7ab-4a19-9493-acf11da38862 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.736769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.739884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.740228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.740511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] PATH_INFO: `/v3/projects/78b943428ccd412b8b457e1f57f194c0/users/4e280d17bdb54b028970f63f9ded6cac/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.743583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b943428ccd412b8b457e1f57f194c0, user_id=4e280d17bdb54b028970f63f9ded6cac, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:58.746251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:58.757087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 981/1988] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:10:58 2022] PUT /identity/v3/projects/78b943428ccd412b8b457e1f57f194c0/users/4e280d17bdb54b028970f63f9ded6cac/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:10:58.769438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.772762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.772762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.800477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] MFA Rules not processed for user `4e280d17bdb54b028970f63f9ded6cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:10:58.810339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:58.837093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:58.888312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1008/1989] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:10:58.911049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:58.913188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:58.980572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160521e-5792-4751-b537-f2b89a810ab5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:58.987738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:58.988431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:58.988709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:58.988979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:58.998832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:59.000354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:59.017065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 982/1990] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:10:59.070895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:10:59.072477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:10:59.090158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856034-3c6d-4553-8a3c-65b945a827db None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:10:59.094545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:10:59.095149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:10:59.095452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:10:59.095843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:10:59.158486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:10:59.159823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:10:59.169325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1009/1991] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:10:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:03.527598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:03.529104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:03.606130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383093a-b143-42af-b2cd-f4c00d4ebe70 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:03.611119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:03.611753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:03.612095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:03.612377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] PATH_INFO: `/v3/users/8eeb6e15b5f4436380419253c79a58fd` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:03.613574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eeb6e15b5f4436380419253c79a58fd)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:03.615545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:03.805005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eeb6e15b5f4436380419253c79a58fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:03.817253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eeb6e15b5f4436380419253c79a58fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:03.824104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eeb6e15b5f4436380419253c79a58fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:03.824821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eeb6e15b5f4436380419253c79a58fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:03.918726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eeb6e15b5f4436380419253c79a58fd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:03.926916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 983/1992] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:03 2022] DELETE /identity/v3/users/8eeb6e15b5f4436380419253c79a58fd => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:04.169037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.182523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf41a-a9fc-4ade-9a66-872095e1a161 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.248954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.250852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:04.251624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.252423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.252806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.253199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] PATH_INFO: `/v3/projects/ab889e0f5d354c2a93ded904ef10ac1f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.254399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab889e0f5d354c2a93ded904ef10ac1f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.256516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.264459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1229-8c93-4157-9971-4d26cafc7485 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.271674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.276092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.276092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.276092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] PATH_INFO: `/v3/users/e66658ff58974f84adcef8b7e28ca315` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.277278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66658ff58974f84adcef8b7e28ca315)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.279721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.288368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.364925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab889e0f5d354c2a93ded904ef10ac1f', 'request_id': 'req-6dd2c1a3-beed-4f78-a470-df381210e4a6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.372263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab889e0f5d354c2a93ded904ef10ac1f', 'request_id': 'req-6dd2c1a3-beed-4f78-a470-df381210e4a6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.378583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab889e0f5d354c2a93ded904ef10ac1f', 'request_id': 'req-6dd2c1a3-beed-4f78-a470-df381210e4a6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.380414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.469360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] The token cache is being invalidate because project ab889e0f5d354c2a93ded904ef10ac1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:04.469669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.470582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6dd2c1a3-beed-4f78-a470-df381210e4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.475489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1010/1993] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:04 2022] DELETE /identity/v3/projects/ab889e0f5d354c2a93ded904ef10ac1f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:04.477133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fba90-6dc3-4b2d-b687-2f1b82426615 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.477972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fba90-6dc3-4b2d-b687-2f1b82426615 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.477972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fba90-6dc3-4b2d-b687-2f1b82426615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.482158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66658ff58974f84adcef8b7e28ca315'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.496563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66658ff58974f84adcef8b7e28ca315'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.503341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-186fba90-6dc3-4b2d-b687-2f1b82426615 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:04.505039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-186fba90-6dc3-4b2d-b687-2f1b82426615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:04.505596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66658ff58974f84adcef8b7e28ca315'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.511755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66658ff58974f84adcef8b7e28ca315'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.569382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1011/1994] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:04.577266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.578301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.578605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.578831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-cae87de7-34a1-469e-96bc-c722eae311c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66658ff58974f84adcef8b7e28ca315'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:04.585234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 984/1995] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:04 2022] DELETE /identity/v3/users/e66658ff58974f84adcef8b7e28ca315 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:04.593973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.594314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.594601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.600157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:04.602564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:04.616448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:04.617651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:04.666724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1012/1996] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:04.670976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.680076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53745e-a9db-406e-80d4-8601e5468508 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.682329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 985/1997] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:04.684700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.685296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.685575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.685850 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.686460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:04.686758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.689041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.692772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.694108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:04.701748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1013/1998] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:11:04.706098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.719244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb404-af85-434d-a402-02c5d9065b8b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.724015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.724636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.724917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.725212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.725992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.729021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.758021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42ad3a-4291-4112-ae40-d4988f229628 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.761907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.762529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.762812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.763216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.773603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.775190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.784988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 986/1999] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:04.815057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1014/2000] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:04 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:04.820074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.829671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26819860-3be3-4559-883f-a7570ef210ae service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.857084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.888794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:04.889414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:04.889702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:04.890028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:04.890668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:04.892689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:04.977610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 987/2001] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:04 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:04.978782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:04.989611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290898b-2816-4b3e-b707-fb2fcd908d59 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:04.994568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.001069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.001069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.001069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.001069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.001069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.009696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1015/2002] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:05.014090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.024447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1558b-0bf7-4a8f-b3f6-b831f5d92253 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.029310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.030080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.030775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.035708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.035708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.035708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d5e7b-24c4-4b6c-90f6-64c021cdd4c7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.044036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 988/2003] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:05.049378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.059547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841324fe-09c7-43d9-8e94-8fedecc7bc6a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.065073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.065754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.066031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.066300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] PATH_INFO: `/v3/projects/ef3b633d315243fb866d6bca1c3398c4/users/529a58dd330f4bceb95d2433c755c6f8/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.082075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3b633d315243fb866d6bca1c3398c4, user_id=529a58dd330f4bceb95d2433c755c6f8, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.085035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.160393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1016/2004] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:05 2022] PUT /identity/v3/projects/ef3b633d315243fb866d6bca1c3398c4/users/529a58dd330f4bceb95d2433c755c6f8/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:05.176029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.176318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.176594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.207288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] MFA Rules not processed for user `529a58dd330f4bceb95d2433c755c6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:05.208601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:05.237403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.238639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:05.275172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:05.306697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 989/2005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:05.313845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.338825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17a15a-2316-494b-80c4-895fc1c53a7d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.340691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.341551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.341835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.342110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] PATH_INFO: `/v3/projects/661687e7cab043f2b1e7b1500f562fa1` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.343348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661687e7cab043f2b1e7b1500f562fa1)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.345477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.379826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c60ea8-761d-4b15-876e-8a3ba74bf406 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.384915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.385538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.385867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.386199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.386846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.388779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.446060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661687e7cab043f2b1e7b1500f562fa1', 'request_id': 'req-0f87aa76-5aa7-45cb-b4bf-1462a014df34'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.453375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661687e7cab043f2b1e7b1500f562fa1', 'request_id': 'req-0f87aa76-5aa7-45cb-b4bf-1462a014df34'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.458958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661687e7cab043f2b1e7b1500f562fa1', 'request_id': 'req-0f87aa76-5aa7-45cb-b4bf-1462a014df34'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.518991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 990/2006] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:05 2022] POST /identity/v3/projects => generated 369 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:05.520006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.550480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] The token cache is being invalidate because project 661687e7cab043f2b1e7b1500f562fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:05.552019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.552019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.553446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1017/2007] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:05 2022] DELETE /identity/v3/projects/661687e7cab043f2b1e7b1500f562fa1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:05.554433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:05.558296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.560741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:05.605970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5113-e8ca-4679-9de4-5e2af6e4fc12 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.612000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.612625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.612906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.613183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.613826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.615799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.642664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87aa76-5aa7-45cb-b4bf-1462a014df34 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.647724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.648789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.648789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.649032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] PATH_INFO: `/v3/users/4e280d17bdb54b028970f63f9ded6cac` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.650250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e280d17bdb54b028970f63f9ded6cac)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.652311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.702869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 991/2008] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:05 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:05.712503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.712503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:05.721818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc60-6640-4770-9413-67d3636b2481 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.726305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.727012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.727289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.727558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.728222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.729811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.740123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 992/2009] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:05.744168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.754326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b913cf-9957-43ff-9b2a-2a7bf128229d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.759163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.759789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.760172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.760445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] PATH_INFO: `/v3/projects/16acf7ec83c245998dc04d921375cb56/users/1b9209454b794ca4812c00b4b3affc0f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.776619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16acf7ec83c245998dc04d921375cb56, user_id=1b9209454b794ca4812c00b4b3affc0f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.779323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.848875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e280d17bdb54b028970f63f9ded6cac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.854274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:05.861867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e280d17bdb54b028970f63f9ded6cac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.869096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e280d17bdb54b028970f63f9ded6cac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.870409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 993/2010] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:05 2022] PUT /identity/v3/projects/16acf7ec83c245998dc04d921375cb56/users/1b9209454b794ca4812c00b4b3affc0f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:05.878869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.938052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1de89-6914-4469-b2c5-5f837d49afc1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:05.942800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:05.943545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:05.943882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:05.944337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:05.945575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:05.947851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad1f7-7bab-4b29-872a-b664e7e14bc2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:05.954648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e280d17bdb54b028970f63f9ded6cac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.955343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e280d17bdb54b028970f63f9ded6cac'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:05.962091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1018/2011] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:05 2022] DELETE /identity/v3/users/4e280d17bdb54b028970f63f9ded6cac => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:05.962813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 994/2012] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:05.966754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:05.968206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.035817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d6277-16e7-4c7b-bec7-4049ce4fb562 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:06.040589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:06.041277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:06.041565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:06.041823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] PATH_INFO: `/v3/projects/16acf7ec83c245998dc04d921375cb56/users/1b9209454b794ca4812c00b4b3affc0f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:06.043773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16acf7ec83c245998dc04d921375cb56, user_id=1b9209454b794ca4812c00b4b3affc0f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:06.046493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:06.057167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1019/2013] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:05 2022] PUT /identity/v3/projects/16acf7ec83c245998dc04d921375cb56/users/1b9209454b794ca4812c00b4b3affc0f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:06.069731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:06.070158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:06.070549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:06.100550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] MFA Rules not processed for user `1b9209454b794ca4812c00b4b3affc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:06.101765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.169063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:06.176214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 995/2014] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:06.187602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:06.190697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.258514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d796e1-59b7-4b49-a867-af73c603f9a0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:06.262372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:06.262995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:06.263274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:06.263770 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:06.276828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:06.278602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:06.288740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1020/2015] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:06.384112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:06.385496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.393232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:06.394988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.397822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99668d4-55ad-4225-93ea-397171b8b1dd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:06.401866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:06.402472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:06.402752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:06.403022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:06.409777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:06.476375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:06.477532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae308e-75ce-4388-b45c-c46802f5e174 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:06.477959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:06.482131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:06.482762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:06.483165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:06.483442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] PATH_INFO: `/v3/projects/78b943428ccd412b8b457e1f57f194c0` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:06.485076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b943428ccd412b8b457e1f57f194c0)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:06.486968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:06.487820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 996/2016] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:06.498250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:06.600821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b943428ccd412b8b457e1f57f194c0', 'request_id': 'req-a68bf6d5-fc0c-4628-bff8-eb81e3123955'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:06.609959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b943428ccd412b8b457e1f57f194c0', 'request_id': 'req-a68bf6d5-fc0c-4628-bff8-eb81e3123955'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:06.616677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b943428ccd412b8b457e1f57f194c0', 'request_id': 'req-a68bf6d5-fc0c-4628-bff8-eb81e3123955'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:06.695924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] The token cache is being invalidate because project 78b943428ccd412b8b457e1f57f194c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:06.696187 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:06.696785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a68bf6d5-fc0c-4628-bff8-eb81e3123955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:06.698539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1021/2017] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:06 2022] DELETE /identity/v3/projects/78b943428ccd412b8b457e1f57f194c0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:09.679111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:09.680697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:09.695477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc809b9-25c1-497c-8373-121de2dab16f service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:09.752166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:09.752809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:09.753092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:09.753370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] PATH_INFO: `/v3/users/4c5841fc4b774c01bce07d8e7d5312d1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:09.754503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5841fc4b774c01bce07d8e7d5312d1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:09.756494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:09.941377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5841fc4b774c01bce07d8e7d5312d1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:09.953705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5841fc4b774c01bce07d8e7d5312d1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:09.961854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5841fc4b774c01bce07d8e7d5312d1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:09.962676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5841fc4b774c01bce07d8e7d5312d1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.041453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5841fc4b774c01bce07d8e7d5312d1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.048814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 997/2018] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:09 2022] DELETE /identity/v3/users/4c5841fc4b774c01bce07d8e7d5312d1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:10.053330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:10.053825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:10.053920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:10.076519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:10.077791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:10.142672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1022/2019] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:10.154014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:10.154014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:10.173909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:10.216099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340f3d8-b16f-463a-a634-66f35da9482d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:10.219791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:10.220439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:10.223235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:10.223235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:10.230696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:10.231968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c033618-483b-44f2-830f-fb041ec75798 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:10.242180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 998/2020] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:10.683507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:10.685757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:10.710521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e5094-7bdb-4b96-893e-a8efefc7f5ef None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:10.720157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:10.720846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:10.721124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:10.721398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] PATH_INFO: `/v3/projects/641b9b53d1be4dfb90aa46d18411955a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:10.725483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641b9b53d1be4dfb90aa46d18411955a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:10.727431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:10.897543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641b9b53d1be4dfb90aa46d18411955a', 'request_id': 'req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.903838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641b9b53d1be4dfb90aa46d18411955a', 'request_id': 'req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.910277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641b9b53d1be4dfb90aa46d18411955a', 'request_id': 'req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.987069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] The token cache is being invalidate because project 641b9b53d1be4dfb90aa46d18411955a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:10.987265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.987909 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4bd8b5d1-5eac-4b68-a047-6e9e16dd1009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:10.989456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1023/2021] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:10 2022] DELETE /identity/v3/projects/641b9b53d1be4dfb90aa46d18411955a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:10.994416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:10.994884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:10.994977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.019083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:11.020371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.085720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 999/2022] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:11.090699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.091174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.091297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.112095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:11.113582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.121306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1024/2023] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:11.126232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.136502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571dd5c-576a-401d-a8c9-0c664a84d577 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.141645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.142269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.142551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.142832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.143488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:11.143792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.145507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.158253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1000/2024] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:11.162717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.172240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772a7d5-621b-425c-b94b-0e489adb6a48 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.177349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.177947 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.178229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.178501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.179126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.181600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.196974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:11.276335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1025/2025] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:11.280263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.290830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec63c3-6820-4961-aac4-cad223b86baa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.353143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.356145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.356483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.356767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.357426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.358167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.359394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.360326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.373487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac67279-129b-4a72-a923-0237c0718e9b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.379230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.380010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.380380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.380659 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] PATH_INFO: `/v3/users/529a58dd330f4bceb95d2433c755c6f8` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.381817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529a58dd330f4bceb95d2433c755c6f8)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.383726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.491313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1001/2026] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:11 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:11.495358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.505729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e0c1-7c44-49ad-a7f6-fe27b365a65f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.510799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.511408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.511749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.512013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.513075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.514325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.529477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1002/2027] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:11.533336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.543962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c202d-e00f-4592-ad98-93c4d004300b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.549486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.550107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.550375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.550650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.551292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.552921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.564401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1003/2028] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:11.568308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.578444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8f04-e0a6-41c4-af25-1c442f900e9e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.583151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.583804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.584120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.584404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] PATH_INFO: `/v3/projects/2da99cd8852f4cc0ad3f59347350d202/users/5c600373c77c4207965e19607c620101/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.596649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:11.602627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da99cd8852f4cc0ad3f59347350d202, user_id=5c600373c77c4207965e19607c620101, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.605438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ed760-6474-4b3e-bbb1-24c92cb15cb3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.618457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529a58dd330f4bceb95d2433c755c6f8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:11.631217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529a58dd330f4bceb95d2433c755c6f8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:11.638026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529a58dd330f4bceb95d2433c755c6f8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:11.691423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1004/2029] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:11 2022] PUT /identity/v3/projects/2da99cd8852f4cc0ad3f59347350d202/users/5c600373c77c4207965e19607c620101/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:11.701538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.701824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.702100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.715969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529a58dd330f4bceb95d2433c755c6f8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:11.717104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-427af45f-4750-4baa-a698-81883b8e9192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529a58dd330f4bceb95d2433c755c6f8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:11.724014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1026/2030] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:11 2022] DELETE /identity/v3/users/529a58dd330f4bceb95d2433c755c6f8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:11.728247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.732984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.732984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.733210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] MFA Rules not processed for user `5c600373c77c4207965e19607c620101`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:11.734846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.755894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:11.755894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.813470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1005/2031] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:11.818361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1027/2032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:11.828274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.829753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.831626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:11.833064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:11.888025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e70a86-00e1-4f52-95ea-19fef5d9646c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.891660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.892312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.892592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.892863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.895006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412dbc0-c30b-4fe7-8b09-81d4667ac4de None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:11.899013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:11.899624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:11.899910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:11.900218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:11.902256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.903675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.909824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:11.911251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:11.913607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1006/2033] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:11.920183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1028/2034] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:12.344663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:12.346148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:12.361267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9193244-da84-4ba5-a633-723b7f3af2ce service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:12.368099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:12.368973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:12.369289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:12.369570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] PATH_INFO: `/v3/projects/ef3b633d315243fb866d6bca1c3398c4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:12.370762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3b633d315243fb866d6bca1c3398c4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:12.372747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:12.465345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3b633d315243fb866d6bca1c3398c4', 'request_id': 'req-ed47b6bd-eef8-4089-a232-acda85ebf010'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.544372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3b633d315243fb866d6bca1c3398c4', 'request_id': 'req-ed47b6bd-eef8-4089-a232-acda85ebf010'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.552409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3b633d315243fb866d6bca1c3398c4', 'request_id': 'req-ed47b6bd-eef8-4089-a232-acda85ebf010'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.563383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] The token cache is being invalidate because project ef3b633d315243fb866d6bca1c3398c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:12.563688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.564961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.565899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1007/2035] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:12 2022] DELETE /identity/v3/projects/ef3b633d315243fb866d6bca1c3398c4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:12.569836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:12.581460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b7d3c-c42b-4d4b-822f-aaf184c730ad service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:12.588848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:12.661330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:12.661978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:12.662265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:12.662533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] PATH_INFO: `/v3/users/1b9209454b794ca4812c00b4b3affc0f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:12.663664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9209454b794ca4812c00b4b3affc0f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:12.665620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:12.861178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9209454b794ca4812c00b4b3affc0f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.883638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9209454b794ca4812c00b4b3affc0f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.892269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9209454b794ca4812c00b4b3affc0f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.961735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9209454b794ca4812c00b4b3affc0f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.962482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4e4f1a45-fafc-4be4-9544-338e1c2ff4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9209454b794ca4812c00b4b3affc0f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:12.969334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1029/2036] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:12 2022] DELETE /identity/v3/users/1b9209454b794ca4812c00b4b3affc0f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:13.380789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:13.386292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:13.391668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:13.395930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47b6bd-eef8-4089-a232-acda85ebf010 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:13.460075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:13.460720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:13.460999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:13.461272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] PATH_INFO: `/v3/projects/16acf7ec83c245998dc04d921375cb56` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:13.462381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16acf7ec83c245998dc04d921375cb56)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:13.464306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:13.573993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16acf7ec83c245998dc04d921375cb56', 'request_id': 'req-c7dda94f-7857-4747-83e3-c7a88a45a711'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:13.652658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16acf7ec83c245998dc04d921375cb56', 'request_id': 'req-c7dda94f-7857-4747-83e3-c7a88a45a711'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:13.661570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16acf7ec83c245998dc04d921375cb56', 'request_id': 'req-c7dda94f-7857-4747-83e3-c7a88a45a711'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:13.679789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] The token cache is being invalidate because project 16acf7ec83c245998dc04d921375cb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:13.679789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:13.679789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c7dda94f-7857-4747-83e3-c7a88a45a711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:13.683130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1008/2037] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:13 2022] DELETE /identity/v3/projects/16acf7ec83c245998dc04d921375cb56 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:13.693766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:13.694248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:13.694337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:13.715175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:13.716495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:13.780363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1030/2038] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:13.789186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:13.789475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:13.789754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:13.809941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:13.811151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:13.819664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1009/2039] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:13.823903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:13.834428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eadaaa-4a59-4486-b176-5d6a2eb0f6f9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:13.839543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:13.840223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:13.840506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:13.840779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:13.841447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:13.841761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:13.844618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:13.856840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1031/2040] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:13.861559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:13.871176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232512e7-913b-451e-87e9-2a572e8a9288 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:13.876163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:13.876772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:13.877052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:13.877325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:13.878111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:13.880305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:13.988614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1010/2041] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:13 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:13.993101 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.003532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd53794-03f8-44b5-bf85-089480512bd2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.022647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:14.064099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.064753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.065035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.065311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.065958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.068001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.170326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1032/2042] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:13 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:14.174976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.185561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c815b4-3eba-4080-8561-5e22844e5699 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.190814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.191471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.191775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.196654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.196654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.196654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.205250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1011/2043] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:14.209347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.219898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c117be-a1d9-4ef6-9cb2-98c076144c0c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.225236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.225843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.226253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.226421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.227106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.228919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793545d3-ed2e-473b-855c-e90f39efda4f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.241171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1033/2044] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:14.245420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.256756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027002f-220b-4356-a610-ffa1584f3f92 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.261462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.262122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.262412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.262686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] PATH_INFO: `/v3/projects/f168d665c8ec48a894a7365676aa7e99/users/bf4342122c334bc9b9ab2ec760b10c8b/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.285694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f168d665c8ec48a894a7365676aa7e99, user_id=bf4342122c334bc9b9ab2ec760b10c8b, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.290260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.381978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1012/2045] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:14 2022] PUT /identity/v3/projects/f168d665c8ec48a894a7365676aa7e99/users/bf4342122c334bc9b9ab2ec760b10c8b/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:14.392879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.393160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.393430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.422908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] MFA Rules not processed for user `bf4342122c334bc9b9ab2ec760b10c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:14.424454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:14.491336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1034/2046] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:14.495840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.529073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:14.557344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c527cb-2c4a-420d-8590-7ecc52ee0734 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.562468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.563245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.563523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.563793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.564469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.566434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.670890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1013/2047] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:14 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:14.675750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.687548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc054cbb-2272-49d7-bf40-45c2cbef9eb9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.742786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.743476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.743667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.743936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.744583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.746480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.832018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1035/2048] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:14 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:14.834421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.845032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dafc4e-b88f-46fd-99f7-7d28f20de413 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.849813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.850411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.850688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.850958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.851593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.853238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.863777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1014/2049] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:14.867972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.879044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301374-3a33-4a51-aee7-987477d20e9e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.883706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.884390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.884673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.884953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] PATH_INFO: `/v3/projects/7e7eeb62e428405395c3d255637f0dd1/users/a6808ff987b44e82a79dcebef10ab1e4/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.897202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:14.900637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7eeb62e428405395c3d255637f0dd1, user_id=a6808ff987b44e82a79dcebef10ab1e4, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.903350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.947888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:14.949667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:14.962787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9378f-8136-4d1f-9a62-c5dbe7005628 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:14.967806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:14.969055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:14.969339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:14.969615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] PATH_INFO: `/v3/users/5c600373c77c4207965e19607c620101` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:14.970769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c600373c77c4207965e19607c620101)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:14.972726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:14.982092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1036/2050] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:14 2022] PUT /identity/v3/projects/7e7eeb62e428405395c3d255637f0dd1/users/a6808ff987b44e82a79dcebef10ab1e4/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:14.986697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.049051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1c7d-2f3d-4c73-af37-9acaabf31560 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.053825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.054458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.054819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.055105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.055738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.057368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:15.067950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1037/2051] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:15.072118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.082016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30dec-322a-49c6-b76e-ea2806d7ad66 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.086615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.087240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.087517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.087788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] PATH_INFO: `/v3/projects/7e7eeb62e428405395c3d255637f0dd1/users/a6808ff987b44e82a79dcebef10ab1e4/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.089671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7eeb62e428405395c3d255637f0dd1, user_id=a6808ff987b44e82a79dcebef10ab1e4, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.092265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f329b7-4b3c-4391-9872-51be588605bb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:15.103154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1038/2052] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:15 2022] PUT /identity/v3/projects/7e7eeb62e428405395c3d255637f0dd1/users/a6808ff987b44e82a79dcebef10ab1e4/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:15.115100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.115398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.115677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.145272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] MFA Rules not processed for user `a6808ff987b44e82a79dcebef10ab1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:15.146505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.182547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c600373c77c4207965e19607c620101'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:15.198252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c600373c77c4207965e19607c620101'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:15.206435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c600373c77c4207965e19607c620101'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:15.207593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c600373c77c4207965e19607c620101'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:15.228076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1039/2053] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:15.239186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.240593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.279532 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae071405-fc5f-48ee-8701-bd3bc5c30026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c600373c77c4207965e19607c620101'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:15.292187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1015/2054] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:14 2022] DELETE /identity/v3/users/5c600373c77c4207965e19607c620101 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:15.296907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.297244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.297529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.315286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085323d4-f51f-4f17-9396-9c5eb15a02b0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.318775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:15.320010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.324334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:15.367925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.368816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.369103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.369375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.381991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1016/2055] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:15.392026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.393377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.413130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:15.432814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.434162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:15.444608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1040/2056] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:15.451331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2156e2-b837-400f-9bd0-83138991bb83 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.455284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.455907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.456217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.456488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.466038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.467712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:15.477541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1017/2057] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:15.626507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.635633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4239b-f564-41e3-90d7-88b36049eef0 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.639479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.640759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.641119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.641462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.643366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.710870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.712251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb4a52-5933-4a9e-88f7-fcce6f282878 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:15.721713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1041/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:15.871110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:15.872555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:15.886075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80105ade-2a64-4da9-92e0-7abf64bcdaec service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:15.891841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:15.892513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:15.892944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:15.893257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] PATH_INFO: `/v3/projects/2da99cd8852f4cc0ad3f59347350d202` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:15.894379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da99cd8852f4cc0ad3f59347350d202)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:15.896367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.016979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da99cd8852f4cc0ad3f59347350d202', 'request_id': 'req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:16.095545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da99cd8852f4cc0ad3f59347350d202', 'request_id': 'req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:16.102467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da99cd8852f4cc0ad3f59347350d202', 'request_id': 'req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:16.113624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] The token cache is being invalidate because project 2da99cd8852f4cc0ad3f59347350d202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:16.113914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:16.114552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-293557e3-d4ab-4c7b-8f43-a58f3cf511fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:16.116080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1018/2059] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:15 2022] DELETE /identity/v3/projects/2da99cd8852f4cc0ad3f59347350d202 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:16.121192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.121668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.121878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.142624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:16.143826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:16.211267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1042/2060] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:16.220082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.220369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.220646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.240076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:16.241347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:16.249279 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1019/2061] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:16.254108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.258943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:16.264392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1ec83-c58d-403d-b128-91c99122f1b9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.269777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.270440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.270723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.270995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.271645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:16.271952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.273573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.291253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1043/2062] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:11:16.297445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.307336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbb460-c4a7-4fa1-b8dd-650b31599c4b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.313909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.314526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.314805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.315080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.315717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.317706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.414038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1020/2063] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:16 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:16.417992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.429921 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467a633-7fe7-4795-b17b-a6420c91e97e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.494679 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.495288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.495569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.495843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.496508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.498395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.602345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1044/2064] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:16 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:16.607288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.619634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1374-eb6c-4d23-95e4-73295d76cb83 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.626723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.630905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.630905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.630905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.630905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.630905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.641397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1021/2065] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:16.645539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.655610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20c63-8477-4465-9784-38e1d7de744b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.660724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.661426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.661708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.661984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.662673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.664453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb04f2-850f-444d-b0b5-9d26b087a601 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.675957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1045/2066] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:16.680138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.690736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e147b0-dbf6-4729-aa67-4d2015e39394 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.695247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.695921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.696245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.696517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] PATH_INFO: `/v3/projects/f0c7c5096f084416aaa00d23b82c87f5/users/0d26396002e74d6691bc6383abccd54a/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.711742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c7c5096f084416aaa00d23b82c87f5, user_id=0d26396002e74d6691bc6383abccd54a, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:16.714646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:16.807088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1022/2067] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:16 2022] PUT /identity/v3/projects/f0c7c5096f084416aaa00d23b82c87f5/users/0d26396002e74d6691bc6383abccd54a/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:16.819115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.819401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.819678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:16.847065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] MFA Rules not processed for user `0d26396002e74d6691bc6383abccd54a`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:16.848293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:16.916092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1046/2068] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:16.928484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:16.930355 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:16.973625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:16.987269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b78ee-25db-49db-912c-7626f7e3896b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:16.990857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:16.991454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:16.991728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:16.992055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:17.000911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:17.002323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f1f35-a109-431c-aa6f-89fe463ae93e service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:17.011191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1023/2069] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:20.828178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:20.829675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:20.896270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:20.900722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986115-0043-43f1-a2e0-d55137f4d6dd None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:20.906437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:20.907206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:20.911232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:20.911232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] PATH_INFO: `/v3/users/bf4342122c334bc9b9ab2ec760b10c8b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:20.911232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4342122c334bc9b9ab2ec760b10c8b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:20.911232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:21.119332 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4342122c334bc9b9ab2ec760b10c8b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:21.131769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4342122c334bc9b9ab2ec760b10c8b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:21.138848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4342122c334bc9b9ab2ec760b10c8b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:21.240973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4342122c334bc9b9ab2ec760b10c8b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:21.241598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4342122c334bc9b9ab2ec760b10c8b'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:21.248253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1047/2070] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:20 2022] DELETE /identity/v3/users/bf4342122c334bc9b9ab2ec760b10c8b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:21.252837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155634a8-da09-4651-870f-3876acf6550a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:21.253295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155634a8-da09-4651-870f-3876acf6550a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:21.253384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155634a8-da09-4651-870f-3876acf6550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:21.275082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-155634a8-da09-4651-870f-3876acf6550a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:21.279056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-155634a8-da09-4651-870f-3876acf6550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:21.334949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1024/2071] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:21.345613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:21.347072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:21.407890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b243576-ee38-4831-b7a4-5f18c0e978f0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:21.411723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:21.412359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:21.412649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:21.412926 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:21.422289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:21.424007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:21.433452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1048/2072] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:21.919837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155634a8-da09-4651-870f-3876acf6550a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:21.922473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-155634a8-da09-4651-870f-3876acf6550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:21.934541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155634a8-da09-4651-870f-3876acf6550a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:21.939191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:21.939826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:21.940134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:21.940406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] PATH_INFO: `/v3/projects/f168d665c8ec48a894a7365676aa7e99` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:21.941514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f168d665c8ec48a894a7365676aa7e99)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:21.944144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:22.085035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f168d665c8ec48a894a7365676aa7e99', 'request_id': 'req-85040638-0d54-4eda-aa6a-e1b0e841f073'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.196318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f168d665c8ec48a894a7365676aa7e99', 'request_id': 'req-85040638-0d54-4eda-aa6a-e1b0e841f073'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.203611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f168d665c8ec48a894a7365676aa7e99', 'request_id': 'req-85040638-0d54-4eda-aa6a-e1b0e841f073'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.214836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] The token cache is being invalidate because project f168d665c8ec48a894a7365676aa7e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:22.215021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.215668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.217225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1025/2073] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:21 2022] DELETE /identity/v3/projects/f168d665c8ec48a894a7365676aa7e99 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:22.222414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:22.233041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12d189-9f60-464b-831d-d820c07a91d2 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:22.302147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:22.302889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:22.303162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:22.303434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] PATH_INFO: `/v3/users/a6808ff987b44e82a79dcebef10ab1e4` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:22.304602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6808ff987b44e82a79dcebef10ab1e4)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:22.306530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:22.331772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:22.530578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6808ff987b44e82a79dcebef10ab1e4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.542998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6808ff987b44e82a79dcebef10ab1e4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.550041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6808ff987b44e82a79dcebef10ab1e4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.629389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6808ff987b44e82a79dcebef10ab1e4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.630018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-21c76f63-dfb2-40c4-afb4-4db2e974ad32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6808ff987b44e82a79dcebef10ab1e4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:22.636387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1049/2074] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:22 2022] DELETE /identity/v3/users/a6808ff987b44e82a79dcebef10ab1e4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:23.074129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.075632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:23.088731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85040638-0d54-4eda-aa6a-e1b0e841f073 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.153305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.153959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.154270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.154558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] PATH_INFO: `/v3/projects/7e7eeb62e428405395c3d255637f0dd1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.156703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7eeb62e428405395c3d255637f0dd1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.158720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.167218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:23.317645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7eeb62e428405395c3d255637f0dd1', 'request_id': 'req-50e10be1-2c0b-4f7f-855a-c616e858f11d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:23.424824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7eeb62e428405395c3d255637f0dd1', 'request_id': 'req-50e10be1-2c0b-4f7f-855a-c616e858f11d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:23.431741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7eeb62e428405395c3d255637f0dd1', 'request_id': 'req-50e10be1-2c0b-4f7f-855a-c616e858f11d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:23.443131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] The token cache is being invalidate because project 7e7eeb62e428405395c3d255637f0dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:23.443512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:23.444301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-50e10be1-2c0b-4f7f-855a-c616e858f11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:23.445866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1026/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:23 2022] DELETE /identity/v3/projects/7e7eeb62e428405395c3d255637f0dd1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:23.451221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.452183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.453162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.474776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:23.476586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:23.548011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1050/2076] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:23.555869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.556191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.556469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.578169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:23.580040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:23.588672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1027/2077] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:23.593179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.603672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009176e-ddd7-4682-9194-2e71fa30488e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.608611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.609214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.609490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.609759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.610449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:23.610745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.613297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.625496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1051/2078] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:11:23.629893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.639301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114272a-5f2a-4adc-9d46-77a3cc4ea4b8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.644952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.645555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.645828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.646099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.646726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.648883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.736631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1028/2079] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:23 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:23.740900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.751089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872f3a-207c-4c5a-b1cd-a315d79155c5 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.814950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.815571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.815853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.816164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.819501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.819501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.907209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1052/2080] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:23 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:23.911308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.921786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccace1c-dac6-45a1-9586-672488e918db admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.926821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.927412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.927690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.927962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.928631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.930217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.941433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1029/2081] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:23.945595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.956153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d845-f412-4c19-91da-34be1416acf4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.960817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.961406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.961685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.961959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:23.964610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:23.964610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33ae8e-bf32-484b-9a51-3f30ac1e3bb7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:23.974547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1053/2082] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:23.978648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:23.988706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3235-e8e8-42c5-9d9e-05f7ca6b6cdf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:23.993305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:23.993951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:23.994232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:23.994509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] PATH_INFO: `/v3/projects/3061eb3108684235974e46596ae7ac3f/users/f1bea0862406427681ad02d319238b2f/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.009484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3061eb3108684235974e46596ae7ac3f, user_id=f1bea0862406427681ad02d319238b2f, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.012142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.116063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1030/2083] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:23 2022] PUT /identity/v3/projects/3061eb3108684235974e46596ae7ac3f/users/f1bea0862406427681ad02d319238b2f/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:24.128086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.128396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.128678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.137743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:24.158980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] MFA Rules not processed for user `f1bea0862406427681ad02d319238b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:24.160241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:24.223356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1054/2084] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:24.228233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.290938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ef50-f3f3-48a4-a716-883380fbc27f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.295529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.296176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.296531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.296736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.297926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.300252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.421365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1031/2085] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:24 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:24.423785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.434735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e639d9-839b-43d9-bad6-4c2a357dd5b8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.494279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.494910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.495152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.495424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.496097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.497995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.592985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1055/2086] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:24 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:24.597918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.609143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a91-5078-4a38-b557-dc15384d3b65 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.615412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.616441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.616835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.617284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.618097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.619815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.637381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1032/2087] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:24.638628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.649516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3541b2-0f89-4465-8e68-191fbae0f3a8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.655778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.657454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.658086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.658532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] PATH_INFO: `/v3/projects/f2229543aa1d42e8892dac0b4cd64453/users/51c026a33a4944359d53436839a402ef/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.678944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2229543aa1d42e8892dac0b4cd64453, user_id=51c026a33a4944359d53436839a402ef, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.681890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.755512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1056/2088] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:24 2022] PUT /identity/v3/projects/f2229543aa1d42e8892dac0b4cd64453/users/51c026a33a4944359d53436839a402ef/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:24.759560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.769628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd278f1-4755-4e84-bd92-4a8276582ba6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.773299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:24.831106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.831722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.832032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.832332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.832972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.834579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9324ef-a92d-4c13-90d1-7361c8a403d4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.845553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1033/2089] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:24.849800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:24.862399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e4e53-75b7-45de-9543-30d6579fd458 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:24.869010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:24.869728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.870015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.870284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] PATH_INFO: `/v3/projects/f2229543aa1d42e8892dac0b4cd64453/users/51c026a33a4944359d53436839a402ef/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.872301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2229543aa1d42e8892dac0b4cd64453, user_id=51c026a33a4944359d53436839a402ef, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:24.874999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:24.886639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1057/2090] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:24 2022] PUT /identity/v3/projects/f2229543aa1d42e8892dac0b4cd64453/users/51c026a33a4944359d53436839a402ef/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:24.905886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:24.906131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:24.906413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:24.935030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] MFA Rules not processed for user `51c026a33a4944359d53436839a402ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:24.936282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:25.006449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1034/2091] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:25.017258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:25.018948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:25.072391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:25.077365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6de4-b3d7-4235-938d-6668237e1766 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:25.081420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:25.082024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:25.082303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:25.082592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:25.091767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:25.093279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6770c-59c1-40ee-89b8-279e324b5ae3 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:25.102898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1058/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:25.671484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:25.734578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81a502-e54d-42de-922f-a83c7cc30209 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:25.739700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:25.740351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:25.740635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:25.740909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] PATH_INFO: `/v3/users/f1bea0862406427681ad02d319238b2f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:25.742015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bea0862406427681ad02d319238b2f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:25.743928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:25.939465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:25.952879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bea0862406427681ad02d319238b2f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:25.964704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bea0862406427681ad02d319238b2f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:25.971306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bea0862406427681ad02d319238b2f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:25.971973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bea0862406427681ad02d319238b2f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.046614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bea0862406427681ad02d319238b2f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.053713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1035/2093] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:25 2022] DELETE /identity/v3/users/f1bea0862406427681ad02d319238b2f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:26.058138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:26.058593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:26.058687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:26.077755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:26.079026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:26.141708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1059/2094] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:26.160025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:26.160025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:26.228035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3456e9-60c1-442c-a60d-9b1ac908a97b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:26.232225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:26.232830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:26.233106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:26.233375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:26.243214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:26.244699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:26.255067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1036/2095] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:26.678462 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:26.679924 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:26.693643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fffb9-dda9-416a-92a1-6c8184df7ccf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:26.699687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:26.700389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:26.700668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:26.701449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] PATH_INFO: `/v3/projects/3061eb3108684235974e46596ae7ac3f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:26.702982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3061eb3108684235974e46596ae7ac3f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:26.704810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:26.825216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3061eb3108684235974e46596ae7ac3f', 'request_id': 'req-ac41e618-18d7-4e3b-8892-b593cf13220f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.831442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3061eb3108684235974e46596ae7ac3f', 'request_id': 'req-ac41e618-18d7-4e3b-8892-b593cf13220f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.837282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3061eb3108684235974e46596ae7ac3f', 'request_id': 'req-ac41e618-18d7-4e3b-8892-b593cf13220f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.920853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] The token cache is being invalidate because project 3061eb3108684235974e46596ae7ac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:26.921067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.921677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:26.923172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1060/2096] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:26 2022] DELETE /identity/v3/projects/3061eb3108684235974e46596ae7ac3f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:26.928409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:26.938065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbabd-b6a4-4894-bac5-92d8aa729f3d service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:26.995388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:26.996043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:26.996326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:26.996600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] PATH_INFO: `/v3/users/51c026a33a4944359d53436839a402ef` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:26.997738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c026a33a4944359d53436839a402ef)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:26.999707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:27.204621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c026a33a4944359d53436839a402ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.209826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:27.217539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c026a33a4944359d53436839a402ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.226036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c026a33a4944359d53436839a402ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.226785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c026a33a4944359d53436839a402ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.304224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-04239651-020b-47a4-bfce-836e473b0685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c026a33a4944359d53436839a402ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.310933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1037/2097] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:26 2022] DELETE /identity/v3/users/51c026a33a4944359d53436839a402ef => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:27.760787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:27.762444 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:27.777729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41e618-18d7-4e3b-8892-b593cf13220f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:27.836529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:27.837853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:27.838245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:27.838570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] PATH_INFO: `/v3/projects/f2229543aa1d42e8892dac0b4cd64453` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:27.841309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2229543aa1d42e8892dac0b4cd64453)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:27.843368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:27.859046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:27.976765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2229543aa1d42e8892dac0b4cd64453', 'request_id': 'req-ee18c96c-848c-4b7d-94cc-dc6854c706d1'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.983354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2229543aa1d42e8892dac0b4cd64453', 'request_id': 'req-ee18c96c-848c-4b7d-94cc-dc6854c706d1'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:27.989604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2229543aa1d42e8892dac0b4cd64453', 'request_id': 'req-ee18c96c-848c-4b7d-94cc-dc6854c706d1'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.066975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] The token cache is being invalidate because project f2229543aa1d42e8892dac0b4cd64453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:28.067267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.067882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee18c96c-848c-4b7d-94cc-dc6854c706d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.069420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1061/2098] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:27 2022] DELETE /identity/v3/projects/f2229543aa1d42e8892dac0b4cd64453 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:28.074368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.074830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.074920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.094261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:28.095492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.154715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1038/2099] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:28.163051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.163237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.163525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.196595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:28.198218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.210582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1062/2100] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:28.211801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.230485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f187-b197-4422-8601-d4e9b334b444 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.237062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.237950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.238237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.238519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.239188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:28.239502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.241151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.254594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1039/2101] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:28.259072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.269127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4321a7-1b8d-48b9-9a0c-0ab064001db5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.280076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.280799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.281180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.281554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.282304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.284763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.400264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1063/2102] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:28.406264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.417516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c01a1-1dd0-4d8b-9090-ec358f4cb15f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.466179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.468015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.485487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.486097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.486930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.487214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.487868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.489800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.534195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514a71-84c0-4077-9aab-bcc15e6f53db admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.538872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.539526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.539807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.540125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] PATH_INFO: `/v3/users/73c762a4b57c4458a03d5fd744489f73` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.541289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c762a4b57c4458a03d5fd744489f73)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.543194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.598700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1040/2103] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:28.602767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.612239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109ed4-3df0-4997-bdd0-1ee9703bb33d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.616819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.617390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.617673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.617944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.618601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.620251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.631638 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1041/2104] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:28.635405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.645602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4cc5-5002-4a62-84cf-3462b1d2d355 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.650110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.650718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.650995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.651263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.651908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.653828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.663510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1042/2105] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:28.667473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.678241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666d7b-ab01-4da2-b42c-23baa2883358 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:28.683255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:28.683970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.684289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.684565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] PATH_INFO: `/v3/projects/f628cdc449fd4dfc8949ad1751fa3288/users/7a2410f308c842e4ad181929fbd5b11f/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.700404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f628cdc449fd4dfc8949ad1751fa3288, user_id=7a2410f308c842e4ad181929fbd5b11f, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:28.703022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cc247-8d35-4a46-9ab5-e7e3e7381823 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:28.749858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c762a4b57c4458a03d5fd744489f73'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.762401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c762a4b57c4458a03d5fd744489f73'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.769557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c762a4b57c4458a03d5fd744489f73'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.772135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:28.828097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:28.832812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1043/2106] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:28 2022] PUT /identity/v3/projects/f628cdc449fd4dfc8949ad1751fa3288/users/7a2410f308c842e4ad181929fbd5b11f/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:28.844046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.844350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.844618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.855466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c762a4b57c4458a03d5fd744489f73'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.856665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6da084d6-ba44-4279-ae9a-ff1082b194c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c762a4b57c4458a03d5fd744489f73'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:28.866272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1064/2107] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:28 2022] DELETE /identity/v3/users/73c762a4b57c4458a03d5fd744489f73 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:28.870955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:28.871243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:28.871521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:28.881395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] MFA Rules not processed for user `7a2410f308c842e4ad181929fbd5b11f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:28.882611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.892356 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:28.893570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.946490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1044/2108] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:28.953077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1065/2109] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:28.960721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.962369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:28.962862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:28.964311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:29.020143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a5b4-6b30-4350-9e73-a9d60d8468e7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:29.020408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa828-d77e-47f2-842f-2fb7919f6855 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:29.024081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:29.024684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.024813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:29.024960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.025229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.025826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.026189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.026469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.035720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:29.036646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:29.037472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:29.038220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a96543-a9e4-4d0f-8644-2bb0ee921a7d service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:29.046989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1066/2110] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:29.048151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1045/2111] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:29.068061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:29.071742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:29.083455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a34d9-5474-4fbe-bcad-25ceff2165c0 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:29.088288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:29.088915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.089193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.089487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] PATH_INFO: `/v3/users/7a2410f308c842e4ad181929fbd5b11f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.090616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2410f308c842e4ad181929fbd5b11f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:29.092595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:29.320138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2410f308c842e4ad181929fbd5b11f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.337359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2410f308c842e4ad181929fbd5b11f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.357542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2410f308c842e4ad181929fbd5b11f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.441518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2410f308c842e4ad181929fbd5b11f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.442247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2410f308c842e4ad181929fbd5b11f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.449976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1067/2112] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:29 2022] DELETE /identity/v3/users/7a2410f308c842e4ad181929fbd5b11f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:29.454552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.455156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.455156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.476062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:29.477276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:29.536072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:29.537985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:29.552198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:29.577948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1046/2113] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:29.589297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:29.591405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:29.656448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:29.669556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2436-a1f0-4589-92ce-a8ea7288e8c3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:29.675237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:29.676109 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.676666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.676940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] PATH_INFO: `/v3/projects/b996d13725c04ab3be768230fafe5091` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.678524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b996d13725c04ab3be768230fafe5091)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:29.680511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:29.680918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962684-4c5b-4d09-96f6-6b32f7bdd299 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:29.685403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:29.686012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.686297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.686577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.696682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:29.698186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7de30-a285-4988-a06b-de22928d6505 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:29.715301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1047/2114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:29.806064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b996d13725c04ab3be768230fafe5091', 'request_id': 'req-a04bd02a-155f-425a-a706-184982a6a1a8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.812567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b996d13725c04ab3be768230fafe5091', 'request_id': 'req-a04bd02a-155f-425a-a706-184982a6a1a8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.819113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b996d13725c04ab3be768230fafe5091', 'request_id': 'req-a04bd02a-155f-425a-a706-184982a6a1a8'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.903810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] The token cache is being invalidate because project b996d13725c04ab3be768230fafe5091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:29.904079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.904965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a04bd02a-155f-425a-a706-184982a6a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:29.906893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1068/2115] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:29 2022] DELETE /identity/v3/projects/b996d13725c04ab3be768230fafe5091 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:29.912460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:29.912832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:29.913207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:29.936009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:29.937416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.013717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1048/2116] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:30.022196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.022328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.022660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.044193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:30.045430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.055014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1069/2117] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:30.059395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.075564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f79177-95d9-4669-98e3-fabc905bd899 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.089814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.092848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.092848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.092848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.092848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:30.092848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.094030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.106590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1049/2118] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:30.111052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.120646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975735b-342b-42e3-8884-aee719e8e04b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.125360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.125943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.126218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.126481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.127686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.129586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.234079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.238054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.252763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1070/2119] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:30.257052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.267934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c3aa-b2cf-41a9-ab78-615d364dd36e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.332498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168fe29-90fd-41a8-b206-56f158ac3e4f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.339400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.340071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.340469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.340752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] PATH_INFO: `/v3/projects/f628cdc449fd4dfc8949ad1751fa3288` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.341375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.342184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f628cdc449fd4dfc8949ad1751fa3288)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.342443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.342936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.343296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.345557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.348749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.365376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.485894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:30.495258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1071/2120] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:30.496163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.506464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47b6f-9301-49ce-8d9e-1cc049108dc4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.507219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f628cdc449fd4dfc8949ad1751fa3288', 'request_id': 'req-e8103d14-c683-4f19-bcab-5bf55fa3d855'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:30.565390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.608019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1072/2121] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:30.608592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.617200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56ebc-507d-479b-bd7c-3af32fc066ad admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.623143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.623853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.624169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.624717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.625455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.627137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.639207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1073/2122] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:30.644059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.654889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48015e18-d3cc-4167-acf9-dc199c948b0e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.661159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.661994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.662915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.662915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] PATH_INFO: `/v3/projects/9dc1d82a1deb40e39c8f02e00c99a684/users/78c775fb149549938f546bebc9e6c1dd/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.679511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc1d82a1deb40e39c8f02e00c99a684, user_id=78c775fb149549938f546bebc9e6c1dd, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:30.682469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92804174-60a1-4f2c-b51a-696bf1b5e948 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:30.781066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f628cdc449fd4dfc8949ad1751fa3288', 'request_id': 'req-e8103d14-c683-4f19-bcab-5bf55fa3d855'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:30.793240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f628cdc449fd4dfc8949ad1751fa3288', 'request_id': 'req-e8103d14-c683-4f19-bcab-5bf55fa3d855'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:30.798317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:30.809542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] The token cache is being invalidate because project f628cdc449fd4dfc8949ad1751fa3288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:30.809977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:30.810967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e8103d14-c683-4f19-bcab-5bf55fa3d855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:30.813960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1050/2123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:30 2022] DELETE /identity/v3/projects/f628cdc449fd4dfc8949ad1751fa3288 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:30.818646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a652-c268-4104-9ae3-90cf40e70aee None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.819054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a652-c268-4104-9ae3-90cf40e70aee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.828929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a652-c268-4104-9ae3-90cf40e70aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.831818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1074/2124] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:30 2022] PUT /identity/v3/projects/9dc1d82a1deb40e39c8f02e00c99a684/users/78c775fb149549938f546bebc9e6c1dd/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:30.836044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.838502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.838876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.844636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c2a3a652-c268-4104-9ae3-90cf40e70aee None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:30.846792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c2a3a652-c268-4104-9ae3-90cf40e70aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.876910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] MFA Rules not processed for user `78c775fb149549938f546bebc9e6c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:30.880373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.920034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1051/2125] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:30.927890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.932233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:30.932233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:30.954095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:30.956174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.961671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1075/2126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:30.965891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1052/2127] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:30.969906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.981807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:30.983223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:30.992011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5070d3-a269-487b-b1df-cf52531f42f1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:30.998669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:30.999351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:30.999727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.000115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.000925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:31.001373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.003413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.023172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1076/2128] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:31.040565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.047617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b277abf-4af3-4f35-b0de-75da19db68eb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.053409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.054202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.054534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.054983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.055619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.057989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.061997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bdcd-0e47-4c39-80b7-2ecfca8b3fc7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.066057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.070002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.070002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.070002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.076861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.078427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.088855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1053/2129] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:31.115104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.116644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.130342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a56b-40e4-45f1-8c47-20c75b8c102c service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.135268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.143703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.143703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.143703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] PATH_INFO: `/v3/users/78c775fb149549938f546bebc9e6c1dd` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.143703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c775fb149549938f546bebc9e6c1dd)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.143703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.184097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1077/2130] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:31 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:31.188345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.206866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:31.250985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb203e-77e2-4c22-8aa3-634ca75f09eb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.255866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.258630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.258630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.258630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.258630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.259721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.320521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c775fb149549938f546bebc9e6c1dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:31.332537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c775fb149549938f546bebc9e6c1dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:31.339435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c775fb149549938f546bebc9e6c1dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:31.340911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c775fb149549938f546bebc9e6c1dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:31.370122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1078/2131] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:31 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:31.374113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.375674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.387656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da1fe7-d201-45ed-b815-fed87356a51c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.392255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.397641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.397641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.397641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.397641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.397641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.409970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-8651fc42-af88-41e8-8610-96a0371a1ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c775fb149549938f546bebc9e6c1dd'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:31.410123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1079/2132] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:31.413995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.422536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1054/2133] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:31 2022] DELETE /identity/v3/users/78c775fb149549938f546bebc9e6c1dd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:11:31.424400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ecdd-846c-4728-9f6f-8aa7bd5d0c07 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.424725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.425011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.425289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.432516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:31.449676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:31.451624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.492576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.493204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.493593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.493856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.494526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.496325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.509402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1080/2134] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:31.521129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.534429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1055/2135] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:31.536010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0d26-b1f0-41d3-a0d9-fc37528fcc62 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.542077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.543352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.543696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.544070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] PATH_INFO: `/v3/projects/accee13490db4917a2cdf7be4b3b009c/users/767a411ab7704a1eab72ae64ed94f701/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.544462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.546073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.560526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accee13490db4917a2cdf7be4b3b009c, user_id=767a411ab7704a1eab72ae64ed94f701, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.563242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e634c-237e-4dbd-aee4-9b08f4676da8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.614033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46b39b-193f-4ead-a773-08b8c98c638f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.617723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.618348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.618626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.618894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.637523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.638982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1081/2136] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:31 2022] PUT /identity/v3/projects/accee13490db4917a2cdf7be4b3b009c/users/767a411ab7704a1eab72ae64ed94f701/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:31.639094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.649277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.649648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.649995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.652132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1056/2137] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:11:31.687671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] MFA Rules not processed for user `767a411ab7704a1eab72ae64ed94f701`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:31.689181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.751508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:31.762020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1082/2138] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:31.773622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:31.775114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:31.856015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221189-c716-4fd3-b372-6b8518c35de3 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:31.930658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:31.931362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:31.931711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:31.932084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:31.941423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:31.944786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8c187-f5cd-4fd7-a965-67bf1945346b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:31.952370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1057/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:32.117993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.120745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:32.186824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18517a3d-1f4f-46e0-9914-2a04d8e07d60 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:32.192197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:32.192830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.193110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.193384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] PATH_INFO: `/v3/projects/9dc1d82a1deb40e39c8f02e00c99a684` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.195290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc1d82a1deb40e39c8f02e00c99a684)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:32.207513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:32.337925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc1d82a1deb40e39c8f02e00c99a684', 'request_id': 'req-7f1a0aeb-7d63-466f-9d78-409818333a68'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:32.339642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc1d82a1deb40e39c8f02e00c99a684', 'request_id': 'req-7f1a0aeb-7d63-466f-9d78-409818333a68'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:32.345531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc1d82a1deb40e39c8f02e00c99a684', 'request_id': 'req-7f1a0aeb-7d63-466f-9d78-409818333a68'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:32.429842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] The token cache is being invalidate because project 9dc1d82a1deb40e39c8f02e00c99a684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:32.430209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:32.430912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7f1a0aeb-7d63-466f-9d78-409818333a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:32.432440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1083/2140] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:32 2022] DELETE /identity/v3/projects/9dc1d82a1deb40e39c8f02e00c99a684 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:32.437869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.438162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.438447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.447515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:32.459518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:32.460871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:32.525605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1058/2141] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:32.534078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.534367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.534647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.555192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:32.556447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:32.565020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1084/2142] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:11:32.569482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.578908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e7263-90bf-40bd-bfb5-38deaa2ca69c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:32.583698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:32.584321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.584596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.584863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.585496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:32.585795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:32.588082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:32.601296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1059/2143] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:32.604569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.615738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee41e-4d73-48b6-9fa7-ec310b949e3d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:32.631431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:32.632477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.633052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.633485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.634289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:32.636413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:32.749562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1085/2144] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:32 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:32.753605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.764542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1a4b-fa76-44ee-82d6-941fa28aec35 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:32.834581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:32.835292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.835617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.835893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.836774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:32.838645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:32.947213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1060/2145] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:32 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:32.951417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.961905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321abe4c-c1e4-4bbe-93e1-55e5cdfcae7e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:32.966583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:32.967184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:32.967465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:32.967737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:32.968403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:32.969988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:32.980703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1086/2146] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:32.984848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:32.995892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16042687-7f4c-4edd-8789-084362f866e6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:33.001101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:33.001784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:33.002207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:33.002637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:33.003643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:33.005299 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d89d-2e80-458a-8f62-441a20fd5cd8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:33.019724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1061/2147] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:33.023903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:33.034720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082ed2-8505-470e-a9a6-1c9ca7415d38 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:33.039656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:33.040345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:33.040942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:33.040942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] PATH_INFO: `/v3/projects/729a64c5c19c4c9f80e7ded618806867/users/7c1f07ec46134f1f9f54851e0266d0be/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:33.056879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729a64c5c19c4c9f80e7ded618806867, user_id=7c1f07ec46134f1f9f54851e0266d0be, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:33.059834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:33.176099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1087/2148] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:33 2022] PUT /identity/v3/projects/729a64c5c19c4c9f80e7ded618806867/users/7c1f07ec46134f1f9f54851e0266d0be/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:33.189283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:33.189283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:33.189283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:33.203696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:33.205539 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:33.266225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1062/2149] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:33.277656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:33.281939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:33.310031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:33.342247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686ba4-e89f-4a0c-858e-a4008c393495 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:33.346624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:33.347254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:33.347545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:33.347830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:33.356878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:33.358367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a0e0e-bf9a-43a8-b737-f443080cc768 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:33.368225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1088/2150] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:36.371858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:36.373368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:36.386325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051666be-d6ed-4445-a6a7-fef8cf1da95f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:36.391718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:36.393458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:36.393647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:36.393924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] PATH_INFO: `/v3/users/767a411ab7704a1eab72ae64ed94f701` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:36.395143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767a411ab7704a1eab72ae64ed94f701)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:36.397222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:36.402312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:36.626149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767a411ab7704a1eab72ae64ed94f701'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:36.653052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767a411ab7704a1eab72ae64ed94f701'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:36.668077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767a411ab7704a1eab72ae64ed94f701'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:36.669072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767a411ab7704a1eab72ae64ed94f701'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:36.767528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767a411ab7704a1eab72ae64ed94f701'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:36.776440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1063/2151] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:36 2022] DELETE /identity/v3/users/767a411ab7704a1eab72ae64ed94f701 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:36.781146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:36.782133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:36.782416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:36.810920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:36.812204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:36.934460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1089/2152] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:36.945541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:36.947324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:37.020296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914611-7478-499e-85ec-489249bfe210 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:37.024522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:37.025135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:37.025411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:37.025685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:37.036067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:37.037561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4fea9-7dcf-43d5-8218-55be3eb1c9fc service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:37.050904 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1064/2153] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:37.920862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:37.923242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:37.943071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd85e-773a-49a2-9052-2a6494ee1e2f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:37.962367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:37.962367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:37.962367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:37.962367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] PATH_INFO: `/v3/projects/accee13490db4917a2cdf7be4b3b009c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:37.962913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=accee13490db4917a2cdf7be4b3b009c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:37.964774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.053996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d280-84dd-4942-ab70-f314466ad2c0 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.054590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d280-84dd-4942-ab70-f314466ad2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.054590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72d280-84dd-4942-ab70-f314466ad2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.079245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9d72d280-84dd-4942-ab70-f314466ad2c0 None None] MFA Rules not processed for user `90304d533deb4ab99b62147d898314eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:38.080624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9d72d280-84dd-4942-ab70-f314466ad2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:38.096886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accee13490db4917a2cdf7be4b3b009c', 'request_id': 'req-5b62145c-8381-4869-a3ab-5ba806a829ec'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:38.107391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accee13490db4917a2cdf7be4b3b009c', 'request_id': 'req-5b62145c-8381-4869-a3ab-5ba806a829ec'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:38.115128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accee13490db4917a2cdf7be4b3b009c', 'request_id': 'req-5b62145c-8381-4869-a3ab-5ba806a829ec'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:38.147970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1065/2154] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:38.213940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] The token cache is being invalidate because project accee13490db4917a2cdf7be4b3b009c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:38.214255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:38.215810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5b62145c-8381-4869-a3ab-5ba806a829ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:38.218592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1090/2155] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:37 2022] DELETE /identity/v3/projects/accee13490db4917a2cdf7be4b3b009c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:38.224169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.224452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.224729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.253674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:38.254935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:38.296069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:38.346439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1066/2156] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:38.355566 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.355933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.356417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.401757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:38.403210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:38.424689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1091/2157] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:38.425597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.437713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12155b6-fbbe-41b5-bf60-0a570e63e6f7 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.462984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.463613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.463893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.464241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.464838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:38.465138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.466788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.482899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1067/2158] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:11:38.484686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.493626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79b706-2f88-4b3b-a696-310241fc7aba None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.499303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.499919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.501132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.501132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.501321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.504122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.623761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1092/2159] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:38 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:38.625493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.636399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258417-574b-4387-9d28-76f3a991cd30 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.716576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.717197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.717728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.718401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.718944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.722526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.837393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1068/2160] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:38 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:38.841639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.857902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23584-ad05-4bc0-9fe2-a5cf842d2b8a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.861077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.862071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.862348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.862639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.864143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.866976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.894376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1093/2161] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:11:38.902312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.913994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df57b6-dbc2-4426-909e-090f4499f097 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.919436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.920110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.920389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.920661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.921392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.926776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e1c57-f16f-4f50-8200-aa23c2eb2864 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:38.948009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1069/2162] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:38.951767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:38.964638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf2fd9-bfef-4f70-a157-6980c527c2d8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:38.970065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:38.970760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:38.971433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:38.971865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] PATH_INFO: `/v3/projects/0115b41fba9b46558d878c9069f0477d/users/069bb93d54f946a6b93d06201eda52ef/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:38.975930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:38.994889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0115b41fba9b46558d878c9069f0477d, user_id=069bb93d54f946a6b93d06201eda52ef, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:38.997860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:39.120682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1094/2163] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:38 2022] PUT /identity/v3/projects/0115b41fba9b46558d878c9069f0477d/users/069bb93d54f946a6b93d06201eda52ef/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:39.133965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268572a0-80db-4f03-aa02-d8219c5c5d2d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:39.135277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268572a0-80db-4f03-aa02-d8219c5c5d2d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:39.135561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268572a0-80db-4f03-aa02-d8219c5c5d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:39.216578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-268572a0-80db-4f03-aa02-d8219c5c5d2d None None] MFA Rules not processed for user `069bb93d54f946a6b93d06201eda52ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:39.220384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-268572a0-80db-4f03-aa02-d8219c5c5d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:39.308082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1070/2164] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:39.324477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:39.327844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:39.408180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de625-0524-42b7-a8cb-f5c34e503137 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:39.413972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:39.414586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:39.414862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:39.415129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:39.425469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:39.427448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:39.438029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1095/2165] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:40.849195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:40.849627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:40.849627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:40.894174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] MFA Rules not processed for user `7c1f07ec46134f1f9f54851e0266d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:40.895498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:40.925585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:40.981530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1071/2166] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:40.986559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:40.988288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:41.061780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2d352-1140-46d3-97f2-53324a837899 service glance] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.067167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.067782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.068097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.068372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.069058 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.070938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.183743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1096/2167] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:40 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:11:41.188289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:41.199882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ebeaf-cb7a-41ca-8b59-e5bd173821ee None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.272017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.272017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.272017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.272300 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.272756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.275860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.384463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1072/2168] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:11:41 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:11:41.389433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:41.410878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f2ac-2bf2-4ae7-8a8f-05c29bb72883 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.416236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.416922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.417124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.417398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.418038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.419718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.441126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1097/2169] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:41.445529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:41.478566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4676456-e241-405a-baae-df014f8a0720 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.484703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.490295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.490583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.490866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] PATH_INFO: `/v3/projects/6b24970f13cf47c58e4c34fd388a78fa/users/1bc7e34d4fac434195dd2977beaf2298/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.509851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b24970f13cf47c58e4c34fd388a78fa, user_id=1bc7e34d4fac434195dd2977beaf2298, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.512629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.592884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1073/2170] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:41 2022] PUT /identity/v3/projects/6b24970f13cf47c58e4c34fd388a78fa/users/1bc7e34d4fac434195dd2977beaf2298/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:41.597194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:41.609038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377499-3c4c-4564-91f4-12721d867e37 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.688315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.689608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.689970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.690304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.691055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.694766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d6179-c322-4250-bc70-968604b311bf admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.697535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:41.717157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1098/2171] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:11:41.722161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:41.738936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec686-523b-47f7-8c8b-ca889af2e408 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:41.745936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:41.746787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:41.747044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:41.747367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] PATH_INFO: `/v3/projects/6b24970f13cf47c58e4c34fd388a78fa/users/1bc7e34d4fac434195dd2977beaf2298/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:41.749460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b24970f13cf47c58e4c34fd388a78fa, user_id=1bc7e34d4fac434195dd2977beaf2298, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:41.752308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:41.782413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1074/2172] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:11:41 2022] PUT /identity/v3/projects/6b24970f13cf47c58e4c34fd388a78fa/users/1bc7e34d4fac434195dd2977beaf2298/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:50.738531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730439e-3b6f-4e0b-a361-c114682676e8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:50.742467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730439e-3b6f-4e0b-a361-c114682676e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:50.742868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730439e-3b6f-4e0b-a361-c114682676e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:50.789812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7730439e-3b6f-4e0b-a361-c114682676e8 None None] MFA Rules not processed for user `1bc7e34d4fac434195dd2977beaf2298`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:50.798030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7730439e-3b6f-4e0b-a361-c114682676e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:50.901687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1099/2173] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:50.915738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:50.917478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:51.009147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea4b93-335d-41a6-a618-c8ec418011f6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:51.013229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:51.013888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:51.014166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:51.015286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:51.038584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:51.101387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:51.103206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:51.115264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1075/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:51.483857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:51.484182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:51.484458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:51.505238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:51.506457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:51.586357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1100/2175] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:51.652316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:51.655670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:51.754692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5325-8bd6-443f-ac84-8a05457d4dfc service glance] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:51.778305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:51.780409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:51.781037 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:51.781334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:51.796630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:51.801613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce9e4-b78c-4e21-ae1f-fd0e78232261 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:51.820962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1076/2176] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:11:57.522346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:57.524525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:57.691015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4f6dd-64e2-4872-a225-2bbbe1f68e68 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:57.701665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:57.704736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:57.705245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:57.705851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] PATH_INFO: `/v3/users/0d26396002e74d6691bc6383abccd54a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:57.710194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d26396002e74d6691bc6383abccd54a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:57.712511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:57.947588 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:57.973365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d26396002e74d6691bc6383abccd54a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:58.004132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d26396002e74d6691bc6383abccd54a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:58.012577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d26396002e74d6691bc6383abccd54a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:58.117970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d26396002e74d6691bc6383abccd54a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:58.118860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d26396002e74d6691bc6383abccd54a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:58.128972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1101/2177] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:11:57 2022] DELETE /identity/v3/users/0d26396002e74d6691bc6383abccd54a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:58.134345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:58.134888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:58.135680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:58.159884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:58.161291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:58.246764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1077/2178] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:58.259558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:58.262441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:58.402693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c71b-93fa-4e7f-9579-d8b0619b598f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:58.408550 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:58.409374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:58.409819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:58.410250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:58.437923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:58.439936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef2df-85a3-4b12-b1b8-c6769f460dcb service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:58.455012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1102/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:11:59.171520 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:59.175375 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:59.209012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c006-829b-4692-94fe-38f7d0d1835a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:59.226093 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:59.230021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:59.230583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:59.231090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] PATH_INFO: `/v3/projects/f0c7c5096f084416aaa00d23b82c87f5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:59.234120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c7c5096f084416aaa00d23b82c87f5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:59.243172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:59.512860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:59.514619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c7c5096f084416aaa00d23b82c87f5', 'request_id': 'req-df26274f-fcd0-4682-9245-b2b3cf770188'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:59.617784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c7c5096f084416aaa00d23b82c87f5', 'request_id': 'req-df26274f-fcd0-4682-9245-b2b3cf770188'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:59.625340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c7c5096f084416aaa00d23b82c87f5', 'request_id': 'req-df26274f-fcd0-4682-9245-b2b3cf770188'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:59.666276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] The token cache is being invalidate because project f0c7c5096f084416aaa00d23b82c87f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:11:59.667341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:59.670244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df26274f-fcd0-4682-9245-b2b3cf770188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:11:59.673963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1078/2180] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:11:59 2022] DELETE /identity/v3/projects/f0c7c5096f084416aaa00d23b82c87f5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:11:59.682168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:59.682691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:59.682691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:59.710655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:59.712050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:59.798095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1103/2181] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:59.804083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:59.804565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:59.804852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:59.829994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:11:59.831409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:11:59.848137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1079/2182] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:11:59.849243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:59.867106 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219929dd-6ff2-441a-9672-ffa83568c73a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:59.867364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:59.868094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:59.868468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:59.868820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:59.869540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:11:59.869920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:59.871593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:11:59.888369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1104/2183] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:11:59.893703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:11:59.906473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9caf9a-b9f0-48fe-b420-04b03372b072 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:11:59.913678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:11:59.916777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:11:59.918128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:11:59.918266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:11:59.918878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:11:59.922267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:00.054684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1080/2184] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:11:59 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:12:00.055842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:00.070726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363136c-fa48-4358-8f23-ed799cbbb9de admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:00.136347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:00.176675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:00.177439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:00.177728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:00.178003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:00.178642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:00.181343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:00.368047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1105/2185] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:12:00 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:12:00.368292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:00.433758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5508-2bed-4332-8420-cc5551487f4c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:00.440252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:00.440891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:00.441170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:00.441501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:00.442248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:00.444531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:00.494756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1081/2186] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:00.495025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:00.508962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ec63-06e6-46ad-9768-c9e52b7e4546 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:00.527347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:00.527994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:00.528289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:00.528554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:00.529206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:00.533743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bee9-43d7-477a-915d-63744bbf5914 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:00.547601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1106/2187] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:00.549162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:00.559284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895991-8c44-495e-a49c-6bbfcbd08bff admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:00.564159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:00.564811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:00.565088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:00.565357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] PATH_INFO: `/v3/projects/58910cb8235644d18e9e2c1f3cc0b163/users/19e7abb6616944bba68d9be6604a0f89/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:00.587402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58910cb8235644d18e9e2c1f3cc0b163, user_id=19e7abb6616944bba68d9be6604a0f89, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:00.590178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:00.893796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1082/2188] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:12:00 2022] PUT /identity/v3/projects/58910cb8235644d18e9e2c1f3cc0b163/users/19e7abb6616944bba68d9be6604a0f89/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:12:00.904874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfc7c-f2d4-48b7-8a3a-397c21f2ee36 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:00.905457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfc7c-f2d4-48b7-8a3a-397c21f2ee36 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:00.905457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfc7c-f2d4-48b7-8a3a-397c21f2ee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:00.934570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-29dcfc7c-f2d4-48b7-8a3a-397c21f2ee36 None None] MFA Rules not processed for user `19e7abb6616944bba68d9be6604a0f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:00.935849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-29dcfc7c-f2d4-48b7-8a3a-397c21f2ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:01.014895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1107/2189] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:01.027103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:01.029100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:01.093361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9931d1-f2a0-468f-aef6-74de6a1ba19f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:01.099075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:01.099720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:01.100046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:01.100322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:01.111943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:01.113814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:01.125869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1083/2190] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:05.109002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22905b-dd95-4424-895b-6dc0a84bc029 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:05.109534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22905b-dd95-4424-895b-6dc0a84bc029 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:05.109618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22905b-dd95-4424-895b-6dc0a84bc029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:05.145059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6f22905b-dd95-4424-895b-6dc0a84bc029 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:05.145935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6f22905b-dd95-4424-895b-6dc0a84bc029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:05.253853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1108/2191] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:05.285450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:05.287011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:05.441070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b421-59e9-4268-beb3-37aaf225240f service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:05.445116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:05.445762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:05.446043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:05.446320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:05.458297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:05.468141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d452a78-3c85-4226-9e05-afdbd326a883 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:05.471490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1084/2192] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:12:05.851314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:05.852747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:05.853137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:05.882127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] MFA Rules not processed for user `fa693691cac940b6a07cbdde5e68c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:05.883515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:05.968743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:05.988653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1109/2193] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:06.338764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a0b0-db11-40d2-ba18-58fc9a3d1906 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:06.339262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a0b0-db11-40d2-ba18-58fc9a3d1906 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:06.339356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a0b0-db11-40d2-ba18-58fc9a3d1906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:06.353195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:06.374251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e880a0b0-db11-40d2-ba18-58fc9a3d1906 None None] MFA Rules not processed for user `7c1f07ec46134f1f9f54851e0266d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:06.376146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e880a0b0-db11-40d2-ba18-58fc9a3d1906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:06.465138 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1085/2194] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:13.423091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:13.427340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:13.525020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cd83b-2aed-47be-a563-056862fc18b3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:13.530737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:13.531719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:13.532250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:13.532767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] PATH_INFO: `/v3/users/069bb93d54f946a6b93d06201eda52ef` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:13.534967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069bb93d54f946a6b93d06201eda52ef)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:13.537183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:13.626982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:13.627559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:13.627702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:13.678984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:13.680964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:13.708309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1086/2195] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:12:13.725517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:13.741665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a0633-4093-44b7-88c0-1b8cbbc5042f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:13.748742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:13.749757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:13.750248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:13.750776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:13.766077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:13.768713 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47e1c-3060-4c97-8d79-b7747268b404 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:13.780890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1087/2196] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 08:12:13.796291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069bb93d54f946a6b93d06201eda52ef'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:13.822787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069bb93d54f946a6b93d06201eda52ef'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:13.840240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069bb93d54f946a6b93d06201eda52ef'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:13.976935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069bb93d54f946a6b93d06201eda52ef'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:13.977760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069bb93d54f946a6b93d06201eda52ef'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:13.986815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1110/2197] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:12:13 2022] DELETE /identity/v3/users/069bb93d54f946a6b93d06201eda52ef => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:13.991636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c412-799b-479d-bc03-9447899832cd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:13.991928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c412-799b-479d-bc03-9447899832cd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:13.992233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c412-799b-479d-bc03-9447899832cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:14.020420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7f88c412-799b-479d-bc03-9447899832cd None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:14.021940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7f88c412-799b-479d-bc03-9447899832cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:14.120721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1088/2198] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:12:14.133315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:14.135089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:14.319604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ee9e-d020-470d-8272-a4aa01878699 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:14.331511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:14.332897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:14.333435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:14.333920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:14.351554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:14.359794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a8a20-f108-438b-a536-8ff2dd00265b service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:14.387502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1111/2199] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:15.652176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88c412-799b-479d-bc03-9447899832cd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:15.653658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7f88c412-799b-479d-bc03-9447899832cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:15.675571 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88c412-799b-479d-bc03-9447899832cd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:15.683151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:15.686171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:15.694870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:15.695530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] PATH_INFO: `/v3/projects/0115b41fba9b46558d878c9069f0477d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:15.697890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0115b41fba9b46558d878c9069f0477d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:15.700243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:15.942330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0115b41fba9b46558d878c9069f0477d', 'request_id': 'req-9a48a38c-3044-4a53-bcc0-80df6dca39ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.026231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0115b41fba9b46558d878c9069f0477d', 'request_id': 'req-9a48a38c-3044-4a53-bcc0-80df6dca39ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.036684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0115b41fba9b46558d878c9069f0477d', 'request_id': 'req-9a48a38c-3044-4a53-bcc0-80df6dca39ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.067280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] The token cache is being invalidate because project 0115b41fba9b46558d878c9069f0477d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:12:16.068014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.070067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.074534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1089/2200] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:12:15 2022] DELETE /identity/v3/projects/0115b41fba9b46558d878c9069f0477d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:16.081874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508fd-62c9-41f7-9277-9b21a649dd70 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.082602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508fd-62c9-41f7-9277-9b21a649dd70 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.082602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6508fd-62c9-41f7-9277-9b21a649dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.160827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-aa6508fd-62c9-41f7-9277-9b21a649dd70 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:16.164774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-aa6508fd-62c9-41f7-9277-9b21a649dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:16.169381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:16.170976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:16.201629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:16.205042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:16.352164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1112/2201] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:16.362777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.363730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.364244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.397657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a38c-3044-4a53-bcc0-80df6dca39ea admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:16.415406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:16.418725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:16.419676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.423378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.423958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:16.424277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] PATH_INFO: `/v3/users/19e7abb6616944bba68d9be6604a0f89` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.427673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e7abb6616944bba68d9be6604a0f89)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:16.432190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:16.453918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1113/2202] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:12:16.461347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:16.490750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee3012-e0a2-4fc0-9315-c6a8fe3ece19 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:16.509422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:16.509577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.510979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.511529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.512596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:12:16.525547 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:16.530908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:16.573784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1114/2203] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:12:16.585366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:16.603687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902d0f7-3c76-475a-87d9-c11b786461c7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:16.612208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:16.615067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.615758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.616221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.617192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:16.621150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:16.680006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e7abb6616944bba68d9be6604a0f89'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.706794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e7abb6616944bba68d9be6604a0f89'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.715176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e7abb6616944bba68d9be6604a0f89'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.716595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e7abb6616944bba68d9be6604a0f89'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.778388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1115/2204] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:12:16.779874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:16.791288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:16.830367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-385a666f-e302-400c-abc7-9084f979081f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e7abb6616944bba68d9be6604a0f89'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:16.839759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1090/2205] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:12:16 2022] DELETE /identity/v3/users/19e7abb6616944bba68d9be6604a0f89 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:12:16.845526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:16.851783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:16.852168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:16.935373 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56922-a578-4302-808f-5f6c3bfc4323 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:16.939241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:16.941076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:17.105265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.105811 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.106460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.106744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.107396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.109379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.114483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1091/2206] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:17.126700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:17.128113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:17.205876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:17.213649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1116/2207] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:12:16 2022] POST /identity/v3/users => generated 287 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:12:17.214599 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:17.242642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93b13-38fe-4d62-93c3-e2312ea3c424 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:17.256512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.257137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.257420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.257697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.258351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.261331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.288537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1117/2208] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:17.293353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:17.302428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:17.315226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba96-2d0f-4baf-a8b7-8cec9b5a7d78 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:17.333552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.334295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.334615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.334909 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.335546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.337177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.361195 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1ee8c-2e18-4fca-94a8-620545757dc4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:17.361657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1118/2209] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:17.362595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:17.387289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569440-3799-4cd9-a044-16e8df9bd2fd admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:17.387609 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.388694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.389091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.389460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.398047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.398569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.398569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.399189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] PATH_INFO: `/v3/projects/fe92b0a027c34708a7574be2fee16c67/users/8e68aa81e2f14299ae12850b8c9ddbfd/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.429784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe92b0a027c34708a7574be2fee16c67, user_id=8e68aa81e2f14299ae12850b8c9ddbfd, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.432699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.436427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.436427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0f7cd-edbb-4ff8-8bb5-b0c77ebfaaf9 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.457289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1092/2210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:12:17.542690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1119/2211] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:12:17 2022] PUT /identity/v3/projects/fe92b0a027c34708a7574be2fee16c67/users/8e68aa81e2f14299ae12850b8c9ddbfd/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:17.555473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.555934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.556152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.611899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] MFA Rules not processed for user `8e68aa81e2f14299ae12850b8c9ddbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:17.613462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:17.754348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1093/2212] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:17.766038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:17.768596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:17.889729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825394b2-fbd1-43a2-a79c-4ab1d3a65de7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:17.904825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:17.905467 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:17.906141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:17.906141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:17.925234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:17.926854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acfe0-c7d4-4d77-b913-87c416383f7e service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:17.953466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1120/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:18.879872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:18.879872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:19.056603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fc0e7-dc58-4ddf-873c-289633779a1b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:19.064247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:19.065522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.066323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.066954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] PATH_INFO: `/v3/projects/58910cb8235644d18e9e2c1f3cc0b163` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.068522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58910cb8235644d18e9e2c1f3cc0b163)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:19.070788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:19.320676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58910cb8235644d18e9e2c1f3cc0b163', 'request_id': 'req-608e503b-ba59-4eb4-86e1-65b2feb3c392'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:19.416358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58910cb8235644d18e9e2c1f3cc0b163', 'request_id': 'req-608e503b-ba59-4eb4-86e1-65b2feb3c392'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:19.433567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58910cb8235644d18e9e2c1f3cc0b163', 'request_id': 'req-608e503b-ba59-4eb4-86e1-65b2feb3c392'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:19.446990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:19.462273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] The token cache is being invalidate because project 58910cb8235644d18e9e2c1f3cc0b163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:12:19.464184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:19.468144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-608e503b-ba59-4eb4-86e1-65b2feb3c392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:19.479348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1094/2214] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:12:18 2022] DELETE /identity/v3/projects/58910cb8235644d18e9e2c1f3cc0b163 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:19.495296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.496270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.496270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.530627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:19.531956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:19.622176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1121/2215] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:19.630062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.630347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.630624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.679599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:19.680862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:19.704686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1095/2216] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:19.704902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:19.717738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d2ce-74be-451c-9b9f-c1b703eaea2d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:19.725879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:19.726766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.727055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.727333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.728139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:12:19.728445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:19.733525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:19.749393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1122/2217] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:12:19.754953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:19.767693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b353e-12cb-4465-81f5-d1bcf44f820a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:19.772796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:19.773518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.773852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.774126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.774933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:19.777006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:19.852618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1096/2218] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:12:19 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:12:19.857912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:19.873839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f9a6-f9a6-4b11-bae8-9836fa61d354 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:19.966098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:19.972883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:19.974856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:19.974856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:19.974856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:19.975491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:19.977613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:20.623189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1123/2219] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:12:19 2022] POST /identity/v3/users => generated 300 bytes in 763 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:12:20.625148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:20.638323 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cebe98-a08a-4eec-b505-921872a9f4a9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:20.650224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:20.650963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:20.651251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:20.651632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:20.652400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:20.654130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:20.664760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1097/2220] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:20.668722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:20.679788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe691-ca74-4a05-bdb7-40a06746c1e9 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:20.684563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:20.687785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:20.687785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:20.687785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:20.687785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:20.688409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47866a-ede1-4a6b-8530-e57a5fc4b763 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:20.702056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1124/2221] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:12:20.706929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:20.716977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f978c2-911d-4385-a343-d070bbacf5ab admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:20.725049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:20.725959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:20.726241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:20.726524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] PATH_INFO: `/v3/projects/b45b3fcc9c1f46fb998e2630a9c110e0/users/0dadca5d76c643e0beb71d0539aaf264/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:20.742833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45b3fcc9c1f46fb998e2630a9c110e0, user_id=0dadca5d76c643e0beb71d0539aaf264, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:20.745603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:20.830559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1098/2222] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:12:20 2022] PUT /identity/v3/projects/b45b3fcc9c1f46fb998e2630a9c110e0/users/0dadca5d76c643e0beb71d0539aaf264/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:12:20.888114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300520b-04ac-4a59-90f1-1642e144280b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:20.888778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300520b-04ac-4a59-90f1-1642e144280b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:20.889312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300520b-04ac-4a59-90f1-1642e144280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:20.923899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7300520b-04ac-4a59-90f1-1642e144280b None None] MFA Rules not processed for user `0dadca5d76c643e0beb71d0539aaf264`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:20.925300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7300520b-04ac-4a59-90f1-1642e144280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:21.021219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1125/2223] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:21.033566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:21.035403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:21.147789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4efd7-656c-4d5f-84a5-e28d7c03af35 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:21.153867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:21.154732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:21.155121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:21.155353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:21.169871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:21.171619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:21.199048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1099/2224] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:21.598244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc927-2200-439d-97dc-ed9515ef1bb3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:21.598542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc927-2200-439d-97dc-ed9515ef1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:21.598826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc927-2200-439d-97dc-ed9515ef1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:21.645192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8f0fc927-2200-439d-97dc-ed9515ef1bb3 None None] MFA Rules not processed for user `8e68aa81e2f14299ae12850b8c9ddbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:21.646419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8f0fc927-2200-439d-97dc-ed9515ef1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:21.768887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1126/2225] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 08:12:28.088723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:28.151835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749452-2acc-472b-ab68-8ddd013eb37b service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:28.156314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:28.157505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:28.157928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:28.158205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] PATH_INFO: `/v3/users/0dadca5d76c643e0beb71d0539aaf264` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:28.159329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dadca5d76c643e0beb71d0539aaf264)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:28.161354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:28.314559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:28.322914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dadca5d76c643e0beb71d0539aaf264'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:28.335445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dadca5d76c643e0beb71d0539aaf264'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:28.342273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dadca5d76c643e0beb71d0539aaf264'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:28.342939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dadca5d76c643e0beb71d0539aaf264'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:28.396008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dadca5d76c643e0beb71d0539aaf264'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:28.402754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1100/2226] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:12:28 2022] DELETE /identity/v3/users/0dadca5d76c643e0beb71d0539aaf264 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:28.407238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:28.407790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:28.408116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:28.431200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:28.432436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:28.490804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1127/2227] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:28.500643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:28.502154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:28.565596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88df5f-97fe-40d4-9449-3ec8326b65d5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:28.569345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:28.569977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:28.570238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:28.570515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:28.580382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:28.581821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83587-343a-4f6a-86c8-1ca8996e0a06 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:28.591458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1101/2228] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:29.069945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:29.071305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:29.083737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45351457-edc5-46c2-b5c6-427c9036d4d8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:29.088495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:29.089285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:29.089570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:29.089831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] PATH_INFO: `/v3/projects/b45b3fcc9c1f46fb998e2630a9c110e0` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:29.090999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45b3fcc9c1f46fb998e2630a9c110e0)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:29.092968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:29.100217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:29.255316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45b3fcc9c1f46fb998e2630a9c110e0', 'request_id': 'req-9e139d4b-1352-4765-b2ab-3aeb4552d266'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:29.261925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45b3fcc9c1f46fb998e2630a9c110e0', 'request_id': 'req-9e139d4b-1352-4765-b2ab-3aeb4552d266'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:29.271105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45b3fcc9c1f46fb998e2630a9c110e0', 'request_id': 'req-9e139d4b-1352-4765-b2ab-3aeb4552d266'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:29.376691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] The token cache is being invalidate because project b45b3fcc9c1f46fb998e2630a9c110e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:12:29.377053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:29.377846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9e139d4b-1352-4765-b2ab-3aeb4552d266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:12:29.379408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1128/2229] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:12:29 2022] DELETE /identity/v3/projects/b45b3fcc9c1f46fb998e2630a9c110e0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:12:35.318996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.319583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.319583 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.321608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1102/2230] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:12:35.328212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c539a0-4bc1-44e3-b91d-694efd56fb43 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.328745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c539a0-4bc1-44e3-b91d-694efd56fb43 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.328827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c539a0-4bc1-44e3-b91d-694efd56fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.353532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-21c539a0-4bc1-44e3-b91d-694efd56fb43 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:35.354845 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-21c539a0-4bc1-44e3-b91d-694efd56fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:35.456954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1129/2231] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:12:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:12:35.473766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:35.475272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:35.549410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ad5c5-f8ce-4568-a5ca-98762615181f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:35.553029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ff9dd1806ea4e4bbc4036bfeaeb9856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:35.553642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.553925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.554203 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.564961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:35.566469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45dd2a-0ad7-4fbe-862b-d9334cec352c service glance] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:35.577761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1103/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:35.801453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70685-01fb-437b-b413-64875a887afa None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.801758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70685-01fb-437b-b413-64875a887afa None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.802044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70685-01fb-437b-b413-64875a887afa None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.803388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1130/2233] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:12:35.808339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778226b7-ac91-4712-9eac-3da5044f315c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.808624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778226b7-ac91-4712-9eac-3da5044f315c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.808902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778226b7-ac91-4712-9eac-3da5044f315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.830451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-778226b7-ac91-4712-9eac-3da5044f315c None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:35.831660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-778226b7-ac91-4712-9eac-3da5044f315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:35.883678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1104/2234] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:12:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:35.898511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70685-01fb-437b-b413-64875a887afa None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:35.900271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9ad70685-01fb-437b-b413-64875a887afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:35.913196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70685-01fb-437b-b413-64875a887afa None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:35.916715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:35.917312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:35.917589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:35.917859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:35.926688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:35.929283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06ad4-8a5b-4e8e-8f43-8914e9703a08 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:35.939730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1131/2235] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:36.074380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34f34-30cd-42e6-b8fb-6d89af6b5bbb None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:36.074672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34f34-30cd-42e6-b8fb-6d89af6b5bbb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:36.074951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34f34-30cd-42e6-b8fb-6d89af6b5bbb None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:36.076357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1105/2236] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:12:36.082523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe9b4-72b5-41cd-a2fc-f799ad6d4902 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:36.082805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe9b4-72b5-41cd-a2fc-f799ad6d4902 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:36.083077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe9b4-72b5-41cd-a2fc-f799ad6d4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:36.102322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-820fe9b4-72b5-41cd-a2fc-f799ad6d4902 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:36.103523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-820fe9b4-72b5-41cd-a2fc-f799ad6d4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:36.112784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1132/2237] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:12:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:12:36.123234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf34f34-30cd-42e6-b8fb-6d89af6b5bbb None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:36.134789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf34f34-30cd-42e6-b8fb-6d89af6b5bbb None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:36.138347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:36.138912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:36.139193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:36.139468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:36.148012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:36.150245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:36.151665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:36.162099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1106/2238] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:40.188080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:40.188632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:40.188744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:40.218232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:12:40.218232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:40.282429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1133/2239] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:12:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:12:40.288703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:40.290091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:40.359236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb004d-295d-44fa-9651-696ac92649db service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:40.364326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:40.364934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:40.365217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:40.365497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:40.381070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:40.392018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:40.392926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1107/2240] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:12:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:12:50.261971 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:50.388592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=34 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:54.147893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:54.149536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:54.223485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63742aab-3fc3-4f9f-8219-231c41ef1ba4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:54.228827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:54.229442 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:54.229729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:54.230000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:54.231722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:54.244963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:54.246601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213c22-5af5-40c1-8f4b-0b0f6aaf1bad service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:54.257551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1134/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:12:55.257570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:12:55.260089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:55.281536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65f2b-a1b2-49a4-944b-343df0d6cb57 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:12:55.287217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:12:55.288923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:12:55.288923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:12:55.288923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:12:55.290339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:12:55.374536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:12:55.376005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:12:55.388528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1108/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:12:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:13:01.361484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd92d-40e8-4057-8e49-d16dccf66030 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:01.362401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd92d-40e8-4057-8e49-d16dccf66030 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:01.362762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd92d-40e8-4057-8e49-d16dccf66030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:01.390096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0d2fd92d-40e8-4057-8e49-d16dccf66030 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:01.391436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0d2fd92d-40e8-4057-8e49-d16dccf66030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:01.409084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1135/2243] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:13:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:01.452688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:01.466185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0bc1-7e48-4d5e-9603-444d102f4efe service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:01.497140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:01.498440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:01.498940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:01.499535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:01.510518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:01.512866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:01.534599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1109/2244] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:13:03.762143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09830f-2e4f-4a5f-b025-ab2a150ed103 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:03.762624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09830f-2e4f-4a5f-b025-ab2a150ed103 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:03.762925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09830f-2e4f-4a5f-b025-ab2a150ed103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:03.783377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dc09830f-2e4f-4a5f-b025-ab2a150ed103 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:03.784647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dc09830f-2e4f-4a5f-b025-ab2a150ed103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:03.792458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1136/2245] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:13:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:03.806288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:03.817134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644ee7-6d08-4d08-9e15-519a8e591354 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:03.822097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:03.822696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:03.822969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:03.823237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:03.833352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:03.834984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:03.843166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1110/2246] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:13:04.822974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ce237-5286-4037-acdf-87dccc36827a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:04.823474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ce237-5286-4037-acdf-87dccc36827a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:04.823677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ce237-5286-4037-acdf-87dccc36827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:04.844677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b49ce237-5286-4037-acdf-87dccc36827a None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:04.847338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b49ce237-5286-4037-acdf-87dccc36827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:04.855852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1137/2247] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:13:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:04.869882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:04.882041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644aefd-d361-4091-a33c-2e80398fe0fc service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:04.888786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:04.889636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:04.890064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:04.890485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:04.900504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:04.902073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:04.910542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1111/2248] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:13:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:13:05.489833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496bf3b-e676-4275-b71f-b598cfb712c8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:05.490192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496bf3b-e676-4275-b71f-b598cfb712c8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:05.490478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496bf3b-e676-4275-b71f-b598cfb712c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:05.509639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3496bf3b-e676-4275-b71f-b598cfb712c8 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:05.510833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3496bf3b-e676-4275-b71f-b598cfb712c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:05.520643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1138/2249] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:13:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:05.535345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:05.545801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bf098-c9ca-40c5-8136-17ed604a8649 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:05.551251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:05.551841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:05.552155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:05.552432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:05.560217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:05.561791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:05.569718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1112/2250] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:13:06.215712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:06.216182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:06.216287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:06.237361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:06.238565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:06.245832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1139/2251] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:13:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:06.258588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:06.269993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ebacf-7a25-4a78-aded-86f195efa93b service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:06.274958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:06.275586 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:06.275864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:06.276183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:06.285103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:06.286669 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba605d63-0887-426a-81e1-374952c3d54e service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:06.294556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1113/2252] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:13:09.321889 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:09.323271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:09.405361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbf109-80ab-4570-b603-c10f8e3add81 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:09.410371 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:09.411005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:09.411285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:09.411557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] PATH_INFO: `/v3/users/8e68aa81e2f14299ae12850b8c9ddbfd` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:09.412726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e68aa81e2f14299ae12850b8c9ddbfd)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:09.414629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:09.639292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e68aa81e2f14299ae12850b8c9ddbfd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:09.649328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:09.656601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e68aa81e2f14299ae12850b8c9ddbfd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:09.665713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e68aa81e2f14299ae12850b8c9ddbfd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:09.784737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e68aa81e2f14299ae12850b8c9ddbfd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:09.785298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e68aa81e2f14299ae12850b8c9ddbfd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:09.791829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1140/2253] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:13:09 2022] DELETE /identity/v3/users/8e68aa81e2f14299ae12850b8c9ddbfd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:13:09.796346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:09.796834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:09.796931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:09.817502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:09.818742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:09.892835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1114/2254] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:09.902667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:09.904181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:09.962624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f209498-b084-417b-b7b9-021f4c175071 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:09.966175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:09.966790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:09.967072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:09.967347 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:09.976863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:09.978294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c36a00-234a-45d1-9400-db64dbd1c053 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:09.989112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1141/2255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:13:10.237522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:10.238932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:10.250924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba2edd-a89b-42a4-a7d4-bb4499e88a36 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:10.256377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:10.257131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.257337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.257678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] PATH_INFO: `/v3/projects/fe92b0a027c34708a7574be2fee16c67` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.258752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe92b0a027c34708a7574be2fee16c67)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:10.260961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:10.291056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:10.426492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe92b0a027c34708a7574be2fee16c67', 'request_id': 'req-83a00e07-65ac-4dbd-96c9-f988b2d6e170'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:10.536858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe92b0a027c34708a7574be2fee16c67', 'request_id': 'req-83a00e07-65ac-4dbd-96c9-f988b2d6e170'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:10.543662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe92b0a027c34708a7574be2fee16c67', 'request_id': 'req-83a00e07-65ac-4dbd-96c9-f988b2d6e170'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:10.555853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] The token cache is being invalidate because project fe92b0a027c34708a7574be2fee16c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:13:10.556175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:10.556823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-83a00e07-65ac-4dbd-96c9-f988b2d6e170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:13:10.558346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1115/2256] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:13:10 2022] DELETE /identity/v3/projects/fe92b0a027c34708a7574be2fee16c67 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:13:10.563222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.563678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.563816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.582970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:10.584199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:10.644703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1142/2257] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:10.652572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.652863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.653228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.673988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:10.675473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:10.683473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1116/2258] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:10.687687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:10.698056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57196c-5966-4352-a4f3-3a6cea4d3fd8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:10.702873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:10.703552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.703942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.704305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.705755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:13:10.706273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:10.707929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:10.724281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1143/2259] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:13:10.725341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:10.734709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2350-d94e-4bd6-a515-b2183856852c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:10.740273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:10.740870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.741144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.741413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.742053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:10.744007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:10.843439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1117/2260] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:13:10.848365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:10.860194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dd629-e38d-4e3c-85d4-ac3655f01556 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:10.923173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:10.923851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:10.924415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:10.924725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:10.925372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:10.927279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:10.938354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:11.011314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1144/2261] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:13:10 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:13:11.015478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:11.026312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f5db-9804-4107-9ac2-0b22ac3ee9e8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:11.030909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:11.031497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:11.031775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:11.032142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:11.032805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:11.034394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:11.044338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1118/2262] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:13:11.057009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:11.067404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2e48-2484-48e1-b77f-38baaf82157c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:11.072022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:11.072620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:11.072899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:11.073175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:11.073810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:11.075432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d3134-e275-48c7-9e56-29a4ceb9021f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:11.087476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1145/2263] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:13:11.091065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:11.102857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5fbc-302c-4724-9c48-aec96020cb7e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:11.107738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:11.108501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:11.108775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:11.109052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] PATH_INFO: `/v3/projects/e9958db40df148d288aac408957a8031/users/36db0107468342cd8165af75828bb9eb/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:11.123776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9958db40df148d288aac408957a8031, user_id=36db0107468342cd8165af75828bb9eb, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:11.126972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:11.196160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1119/2264] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:13:11 2022] PUT /identity/v3/projects/e9958db40df148d288aac408957a8031/users/36db0107468342cd8165af75828bb9eb/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:13:11.201217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798f4-9e11-4033-a257-5c2eaf63d500 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:11.201503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798f4-9e11-4033-a257-5c2eaf63d500 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:11.201777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732798f4-9e11-4033-a257-5c2eaf63d500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:11.221261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-732798f4-9e11-4033-a257-5c2eaf63d500 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:11.222438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-732798f4-9e11-4033-a257-5c2eaf63d500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:11.281435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1146/2265] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:13:11.291557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:11.293499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:11.352231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e81b0-3d4c-4e85-8c11-a54dee5f7bb9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:11.355881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:11.356558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:11.356845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:11.357122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:11.367699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:11.369247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c1b5a-b668-4723-ae29-b4ee46f6d98e service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:11.379233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1120/2266] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:13:12.981091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:12.981645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:12.981645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:13.001378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] MFA Rules not processed for user `90304d533deb4ab99b62147d898314eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:13.003316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:13.061650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1147/2267] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:17.914622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:17.915182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:17.915182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:17.959324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] MFA Rules not processed for user `36db0107468342cd8165af75828bb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:17.961509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:18.031803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:18.068853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1121/2268] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:18.073504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.086843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2b55-761c-4185-a6d0-79bb8f9a27ad None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.094578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.095242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.095614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.096263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.096572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.098454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.232382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1148/2269] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:13:18 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:13:18.237073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.247951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdeb3f-9c5d-4aad-8292-e8d1b83ad8fa None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.307500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.308170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.308446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.308715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.309351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.311377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.393120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1122/2270] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:13:18 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:13:18.394375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.404567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f929-cbc1-438a-851a-d4cdbdbbefd0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.413323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.413323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.413323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.413323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.413795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.414322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.429607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1149/2271] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:13:18.430750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.443702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472c0f-b634-44c4-b051-5b0432b18815 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.449275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.449958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.450240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.450512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] PATH_INFO: `/v3/projects/5825f22405c74e9ebcea300404a6956d/users/bd26dcd49b104eef91a4d49a8e607491/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.468119 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5825f22405c74e9ebcea300404a6956d, user_id=bd26dcd49b104eef91a4d49a8e607491, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.470884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.544797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1123/2272] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:13:18 2022] PUT /identity/v3/projects/5825f22405c74e9ebcea300404a6956d/users/bd26dcd49b104eef91a4d49a8e607491/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:13:18.549738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.560323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553902-80d0-4400-a187-9189642e8d2c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.614513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:18.620662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.625600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.625600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.625600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.625600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.625600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4ace-6f5a-4e12-8b0e-b2ca119dfd3b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.635574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1150/2273] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:13:18.640248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:18.654485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21add3-6123-4f99-8c5b-1df988b7230b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:18.656915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:18.658238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:18.658589 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:18.658925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] PATH_INFO: `/v3/projects/5825f22405c74e9ebcea300404a6956d/users/bd26dcd49b104eef91a4d49a8e607491/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:18.661042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5825f22405c74e9ebcea300404a6956d, user_id=bd26dcd49b104eef91a4d49a8e607491, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:18.663862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:18.677330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1124/2274] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:13:18 2022] PUT /identity/v3/projects/5825f22405c74e9ebcea300404a6956d/users/bd26dcd49b104eef91a4d49a8e607491/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:13:25.154616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e5c3-2b97-4e31-a342-da282161af72 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:25.154616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e5c3-2b97-4e31-a342-da282161af72 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:25.154616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e5c3-2b97-4e31-a342-da282161af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:25.188859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c025e5c3-2b97-4e31-a342-da282161af72 None None] MFA Rules not processed for user `bd26dcd49b104eef91a4d49a8e607491`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:25.192299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c025e5c3-2b97-4e31-a342-da282161af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:25.326848 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1151/2275] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:25.341344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:13:25.343309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:25.465716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bc1f-0898-4fa2-a1b1-e97826c26578 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:13:25.473064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:13:25.475074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:25.475074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:25.475074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:25.513625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:25.548381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:13:25.554032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3350-3d00-4fa3-a4bf-def994f39fe1 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:13:25.564175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1125/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:13:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:13:28.348604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c3ee-89d4-4baf-868b-06b03545673c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:28.351336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c3ee-89d4-4baf-868b-06b03545673c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:28.351723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c3ee-89d4-4baf-868b-06b03545673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:28.372287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f5e9c3ee-89d4-4baf-868b-06b03545673c None None] MFA Rules not processed for user `36db0107468342cd8165af75828bb9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:28.373499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5e9c3ee-89d4-4baf-868b-06b03545673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:28.393546 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1152/2277] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:35.572362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=14 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:38.366466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=40 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:40.732413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:40.732909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:40.733003 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:40.752177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] MFA Rules not processed for user `fa693691cac940b6a07cbdde5e68c65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:40.753372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:40.809444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1126/2278] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:13:50.802728 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=25 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:13:56.649658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752cdb-2b0e-45cf-abe4-8da258af0253 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:13:56.650217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752cdb-2b0e-45cf-abe4-8da258af0253 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:13:56.650517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752cdb-2b0e-45cf-abe4-8da258af0253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:13:56.670693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-27752cdb-2b0e-45cf-abe4-8da258af0253 None None] MFA Rules not processed for user `91c021bd2d524d16b5b3f11a2dab8b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:13:56.671906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-27752cdb-2b0e-45cf-abe4-8da258af0253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:13:56.730439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1153/2279] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:13:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:14:02.013356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:02.086724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa4435-e6dd-451b-89da-68ea9e10c8b2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:02.090435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:02.091050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:02.091335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:02.091607 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:02.102339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:02.103779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4d1f-8b4b-4547-954d-b894c5bb7d32 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:02.114696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1127/2280] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:14:06.722381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=25 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:12.110218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=26 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:32.826745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97425466-44e6-410f-873f-a4c5e370398c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:32.827328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97425466-44e6-410f-873f-a4c5e370398c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:32.827328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97425466-44e6-410f-873f-a4c5e370398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:32.847755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-97425466-44e6-410f-873f-a4c5e370398c None None] MFA Rules not processed for user `7024eea9fd7a4859b305e9f7258b9e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:14:32.853951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-97425466-44e6-410f-873f-a4c5e370398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:32.914333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1154/2281] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:14:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:14:34.573670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:34.577942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:34.577942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:34.593311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] MFA Rules not processed for user `90304d533deb4ab99b62147d898314eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:14:34.594538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:34.649094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1128/2282] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:14:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:14:40.012229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97425466-44e6-410f-873f-a4c5e370398c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:40.013843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-97425466-44e6-410f-873f-a4c5e370398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:40.026984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97425466-44e6-410f-873f-a4c5e370398c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:40.032844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:40.033461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:40.033733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:40.034003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:40.035783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:40.054663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:40.056670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8222d9-3695-429f-907f-49fe32afba84 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:40.073920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1155/2283] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:14:41.299628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:41.315580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9846f9-28e9-4440-9694-f821d7677679 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:41.315580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:41.315580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:41.315580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:41.316067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:41.317452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:41.331948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:41.333413 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:41.345145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1129/2284] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:14:47.373553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:47.374071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:47.374183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:47.395410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:14:47.396816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:47.453817 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1156/2285] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:14:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:14:47.616731 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:47.618184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:47.699503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacddb14-2cd7-4b96-abd4-a1d416f10a38 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:47.712927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:47.712927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:47.712927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:47.712927 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:47.718012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:47.719653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:47.728877 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1130/2286] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:14:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:14:50.086938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:50.088577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:50.106152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c68397-f0bc-44ed-8c95-79afeeee180b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:50.114023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:50.114646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:50.114933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:50.115208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:50.124867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:50.129640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:50.131290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:50.141382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1157/2287] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:14:57.724878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=63 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:58.281039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:58.293465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf80203-1757-4283-9de7-10c71c3e0843 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:58.299023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:58.299623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:58.299902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:58.300204 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:58.302022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:58.313931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:58.315495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:58.325698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1131/2288] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:14:58.371757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:14:58.376095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=63 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:58.381554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f37c48-59ab-4f72-97e1-899556f3a2c2 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:14:58.385403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:14:58.386266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:14:58.389822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:14:58.389822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:14:58.389822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:14:58.456602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:14:58.458026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:14:58.467966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1158/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:00.136714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:00.138923 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:00.242895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72d0d-2142-45cb-8ddc-2a6ae824691e service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:00.248565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:00.253126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:00.253126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:00.253126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:00.253126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:00.265282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:00.267401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:00.284373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1132/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:00.323677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:00.325325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:00.339828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f02b9-b935-4809-abd7-4e6950ee6bea service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:00.345188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:00.345819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:00.346283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:00.346560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] PATH_INFO: `/v3/users/7c1f07ec46134f1f9f54851e0266d0be` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:00.347733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1f07ec46134f1f9f54851e0266d0be)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:00.350577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:00.540463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1f07ec46134f1f9f54851e0266d0be'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:00.554320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1f07ec46134f1f9f54851e0266d0be'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:00.561446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1f07ec46134f1f9f54851e0266d0be'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:00.625855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1f07ec46134f1f9f54851e0266d0be'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:00.626492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1f07ec46134f1f9f54851e0266d0be'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:00.634756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1159/2291] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:00 2022] DELETE /identity/v3/users/7c1f07ec46134f1f9f54851e0266d0be => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:00.899006 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:00.927036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233225-4e9b-4211-a830-7bc2c8e9ebd6 service placement] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:01.024921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:01.025574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:01.025851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:01.026308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] PATH_INFO: `/v3/projects/729a64c5c19c4c9f80e7ded618806867` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:01.027474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729a64c5c19c4c9f80e7ded618806867)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:01.029432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:01.167803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729a64c5c19c4c9f80e7ded618806867', 'request_id': 'req-11b45f2d-de21-4aa8-9003-29a6f430c225'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.278210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729a64c5c19c4c9f80e7ded618806867', 'request_id': 'req-11b45f2d-de21-4aa8-9003-29a6f430c225'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.285660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729a64c5c19c4c9f80e7ded618806867', 'request_id': 'req-11b45f2d-de21-4aa8-9003-29a6f430c225'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.305074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] The token cache is being invalidate because project 729a64c5c19c4c9f80e7ded618806867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:01.305519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.306284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.308145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1133/2292] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:00 2022] DELETE /identity/v3/projects/729a64c5c19c4c9f80e7ded618806867 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:01.311992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:01.313431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:01.335210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d92e2c-fdcb-400f-812e-4c8471dedaab admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:01.390776 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:01.394543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:01.394543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:01.394543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] PATH_INFO: `/v3/users/1bc7e34d4fac434195dd2977beaf2298` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:01.394543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc7e34d4fac434195dd2977beaf2298)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:01.395155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:01.406432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:01.598062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc7e34d4fac434195dd2977beaf2298'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.612276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc7e34d4fac434195dd2977beaf2298'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.623813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc7e34d4fac434195dd2977beaf2298'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.686958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc7e34d4fac434195dd2977beaf2298'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.687613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc7e34d4fac434195dd2977beaf2298'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:01.695849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1160/2293] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:01 2022] DELETE /identity/v3/users/1bc7e34d4fac434195dd2977beaf2298 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:01.985898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:01.985898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:02.003070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45f2d-de21-4aa8-9003-29a6f430c225 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:02.007652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:02.108269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:02.109021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:02.109452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:02.109781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] PATH_INFO: `/v3/projects/6b24970f13cf47c58e4c34fd388a78fa` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:02.111063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b24970f13cf47c58e4c34fd388a78fa)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:02.113634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:02.222988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b24970f13cf47c58e4c34fd388a78fa', 'request_id': 'req-f1f56632-66fd-400b-8c32-756275dbd7d7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:02.269015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b24970f13cf47c58e4c34fd388a78fa', 'request_id': 'req-f1f56632-66fd-400b-8c32-756275dbd7d7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:02.276781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b24970f13cf47c58e4c34fd388a78fa', 'request_id': 'req-f1f56632-66fd-400b-8c32-756275dbd7d7'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:02.289101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] The token cache is being invalidate because project 6b24970f13cf47c58e4c34fd388a78fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:02.289399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:02.290177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:02.305253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1134/2294] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:01 2022] DELETE /identity/v3/projects/6b24970f13cf47c58e4c34fd388a78fa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:02.978258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:02.978922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:02.993201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ea4c4-1740-480c-95e9-744adec4f496 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:03.055084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:03.055716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.056022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.056300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] PATH_INFO: `/v3/users/fa693691cac940b6a07cbdde5e68c65c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.057419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa693691cac940b6a07cbdde5e68c65c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:03.059322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:03.221870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:03.223388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:03.251584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa693691cac940b6a07cbdde5e68c65c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.266664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa693691cac940b6a07cbdde5e68c65c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.278333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa693691cac940b6a07cbdde5e68c65c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.306490 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56632-66fd-400b-8c32-756275dbd7d7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:03.308959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa693691cac940b6a07cbdde5e68c65c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.309570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa693691cac940b6a07cbdde5e68c65c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.312025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:03.312623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.312899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.313170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.314896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:03.315750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1161/2295] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:02 2022] DELETE /identity/v3/users/fa693691cac940b6a07cbdde5e68c65c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:03.349302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:03.375350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:03.377032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7662-b985-4044-b0ad-6d1eb90122f2 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:03.387956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1135/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:15:03.563114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:03.564801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:03.576200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:03.631327 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0e5f-3a50-4240-9f65-ae24568fdef8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:03.635914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:03.636571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.636855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.637160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] PATH_INFO: `/v3/projects/0aff4b86f361482e9b072cd1a3e8ff46` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.638273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aff4b86f361482e9b072cd1a3e8ff46)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:03.640212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:03.735408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aff4b86f361482e9b072cd1a3e8ff46', 'request_id': 'req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.742722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aff4b86f361482e9b072cd1a3e8ff46', 'request_id': 'req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.751105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aff4b86f361482e9b072cd1a3e8ff46', 'request_id': 'req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.811876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] The token cache is being invalidate because project 0aff4b86f361482e9b072cd1a3e8ff46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:03.812994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.813681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7e0a89bd-b7e1-4a7a-b041-73684df1f8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:03.816133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1162/2297] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:03 2022] DELETE /identity/v3/projects/0aff4b86f361482e9b072cd1a3e8ff46 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:03.820224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.820508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.820808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.841067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:03.842292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:03.900176 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1136/2298] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:03.907759 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.908085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.908361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.929997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:03.931192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:03.938993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1163/2299] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:03.943169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:03.952772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65164f7-2080-4ef9-81a8-8d1898df2cf9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:03.957529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:03.958132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.958445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.958721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.960005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:03.960340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:03.961997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:03.973433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1137/2300] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:15:03.978470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:03.987766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1e31b-d75f-4ee6-b5da-565452c32bc2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:03.992727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:03.993319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:03.993603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:03.993888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:03.994500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:03.996460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.111107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1164/2301] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:03 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:04.116316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:04.126397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffcccc-13b7-4574-a0bb-8c00cc37f637 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:04.184042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:04.184644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.184924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.185199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.185832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:04.187776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.281348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1138/2302] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:04 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:04.285510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:04.296616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d84ec-3b7d-4edb-a511-1c82af89c087 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:04.301430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:04.302207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.302492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.303066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.303846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:04.305463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.315374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1165/2303] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:04.319811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:04.329675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622f1a5-fc8b-4af7-ad33-ca3939871d28 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:04.334182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:04.335729 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.336043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.336312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.336953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:04.338525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54a38-9e7c-4062-9309-7de68e9123a7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.348856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1139/2304] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:04.353290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:04.362918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354a32-282e-4ee6-906d-d0651ccfca9d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:04.367525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:04.368185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.368464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.368730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] PATH_INFO: `/v3/projects/ce393fc609c74d479f99a0113ae65295/users/cd0fcfbc98c34b469043e22a69487a7a/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.383633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce393fc609c74d479f99a0113ae65295, user_id=cd0fcfbc98c34b469043e22a69487a7a, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:04.386267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.469167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1166/2305] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:04 2022] PUT /identity/v3/projects/ce393fc609c74d479f99a0113ae65295/users/cd0fcfbc98c34b469043e22a69487a7a/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:04.479482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.481368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.481368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.507793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] MFA Rules not processed for user `cd0fcfbc98c34b469043e22a69487a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:04.509130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:04.537318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:04.574749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1140/2306] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:04.586343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:04.588138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:04.624435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:04.648205 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031a1e-6aa5-4bf5-bc9b-dbad22daaa9f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:04.652431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:04.653300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:04.654076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:04.654582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:04.663191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:04.665482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbced6-3c3d-460e-b89a-91179e6cc07b service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:04.674069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1167/2307] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:14.401312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:14.464120 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608987-a15b-4c0c-89b5-286149d582f9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:14.468534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:14.469157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:14.469443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:14.469718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] PATH_INFO: `/v3/users/cd0fcfbc98c34b469043e22a69487a7a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:14.470818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0fcfbc98c34b469043e22a69487a7a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:14.472773 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:14.638100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0fcfbc98c34b469043e22a69487a7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:14.651859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0fcfbc98c34b469043e22a69487a7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:14.658997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0fcfbc98c34b469043e22a69487a7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:14.659690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0fcfbc98c34b469043e22a69487a7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:14.703380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=11 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:14.709147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0fcfbc98c34b469043e22a69487a7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:14.715911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1141/2308] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:14 2022] DELETE /identity/v3/users/cd0fcfbc98c34b469043e22a69487a7a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:14.720503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:14.720787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:14.721094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:14.739742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:14.741022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:14.802060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1168/2309] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:15:14.812178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:14.813806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:14.869161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:14.872853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b786e-2db0-43d3-9627-53606113d3d3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:14.876512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:14.877117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:14.877398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:14.877674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:14.897256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:14.897256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a54cd-d64c-4744-8287-2d57a459e4fb service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:14.898971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1142/2310] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:15.307832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.308294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:15.327709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc7ccf-e55d-4bd4-a46c-bde0f0de512d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:15.333601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:15.335846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.335846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.335846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] PATH_INFO: `/v3/projects/ce393fc609c74d479f99a0113ae65295` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.337810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce393fc609c74d479f99a0113ae65295)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:15.341065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:15.442313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce393fc609c74d479f99a0113ae65295', 'request_id': 'req-762529ee-1edb-4513-a21d-3812b3dd6e90'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:15.448835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce393fc609c74d479f99a0113ae65295', 'request_id': 'req-762529ee-1edb-4513-a21d-3812b3dd6e90'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:15.454478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce393fc609c74d479f99a0113ae65295', 'request_id': 'req-762529ee-1edb-4513-a21d-3812b3dd6e90'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:15.555280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] The token cache is being invalidate because project ce393fc609c74d479f99a0113ae65295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:15.555619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:15.556236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-762529ee-1edb-4513-a21d-3812b3dd6e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:15.557738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1169/2311] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:15 2022] DELETE /identity/v3/projects/ce393fc609c74d479f99a0113ae65295 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:15.562553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.563018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.563123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.583228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:15.584459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:15.642756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1143/2312] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:15.651149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.651441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.651720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.672950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:15.674114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:15.682804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1170/2313] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:15.686973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.697660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b600458-97d0-44d7-b4ef-c4b686324d3d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:15.702311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:15.703057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.703179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.703447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.704130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:15.704435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:15.706033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:15.718693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1144/2314] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:15:15.723047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.732206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927412a-c954-43b8-80e3-2a8343b19cde None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:15.736954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:15.737569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.737846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.738113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.738737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:15.740649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:15.807512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1171/2315] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:15 2022] POST /identity/v3/projects => generated 403 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:15.811845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.821736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298997d8-759a-4c5b-87b4-335596c66811 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:15.877310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:15.877917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.878196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.878470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.879108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:15.881063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:15.949958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1145/2316] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:15 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:15.954309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.965018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141dfb-c29b-4a0d-a2a4-0e90ce2b555f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:15.969605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:15.970792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:15.970792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:15.970792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:15.971338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:15.972953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:15.984029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1172/2317] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:15.988076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:15.998073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ae3e-f604-4877-a08d-3917195ec14b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.002619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.003202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.003477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.003747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.004414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.005974 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a4b3e-2a70-4ef1-b9c2-7de560073b44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.016840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1146/2318] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:16.020819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.031500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f3836-3be5-4b68-bf76-3d3f0432e43a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.036093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.036737 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.037017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.037290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] PATH_INFO: `/v3/projects/7ea900be16984f0bb81d41a407ae766d/users/0a7bdf78b4ed4dcb9b0100c97650a1fc/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.052463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea900be16984f0bb81d41a407ae766d, user_id=0a7bdf78b4ed4dcb9b0100c97650a1fc, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.055397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.104681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1173/2319] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:16 2022] PUT /identity/v3/projects/7ea900be16984f0bb81d41a407ae766d/users/0a7bdf78b4ed4dcb9b0100c97650a1fc/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:16.115408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.115682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.115953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.144436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] MFA Rules not processed for user `0a7bdf78b4ed4dcb9b0100c97650a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:16.145643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:16.190076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:16.209657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1147/2320] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:16.214928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.235417 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:16.275377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215563-a665-4fab-bf55-4db2e5b215fd admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.280001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.280605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.280882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.281153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.281785 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.283654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.384856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1174/2321] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:16 2022] POST /identity/v3/projects => generated 403 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:16.388936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.400374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0eac0-9e83-4201-9d22-53f1614adcdd None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.457311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.458002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.458317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.458594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.459229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.461324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.523588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1148/2322] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:16 2022] POST /identity/v3/users => generated 308 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:16.525137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.536016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3bee0-0c2d-4b02-9252-412d0c80d885 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.541342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.542133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.542450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.542665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.543302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.545024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.557265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1175/2323] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:15:16.561433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.571905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e49a-5544-4406-9261-5903efb18f58 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.576560 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.577227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.577504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.577776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] PATH_INFO: `/v3/projects/72302ec7992e4fbb8d04d6a165c26c85/users/f8277a3c2b224671b1cf4c5c9cd4b1bf/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.592439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72302ec7992e4fbb8d04d6a165c26c85, user_id=f8277a3c2b224671b1cf4c5c9cd4b1bf, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.595056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.641499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1149/2324] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:16 2022] PUT /identity/v3/projects/72302ec7992e4fbb8d04d6a165c26c85/users/f8277a3c2b224671b1cf4c5c9cd4b1bf/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:15:16.645504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.656147 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc0fb-f31a-455a-988c-d7a998cd217f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.713430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.713979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.714254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.714523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.715162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.716771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda369-91cc-47e5-8297-ddf3baa0996c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.726570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1176/2325] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:16.730871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.741263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c854-1fd6-4fd2-9299-dda6f975e0e7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.746397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.747047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.747329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.747627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] PATH_INFO: `/v3/projects/72302ec7992e4fbb8d04d6a165c26c85/users/f8277a3c2b224671b1cf4c5c9cd4b1bf/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.749569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72302ec7992e4fbb8d04d6a165c26c85, user_id=f8277a3c2b224671b1cf4c5c9cd4b1bf, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.752358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.763368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1150/2326] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:16 2022] PUT /identity/v3/projects/72302ec7992e4fbb8d04d6a165c26c85/users/f8277a3c2b224671b1cf4c5c9cd4b1bf/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:16.774890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.775176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.775451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.804364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] MFA Rules not processed for user `f8277a3c2b224671b1cf4c5c9cd4b1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:16.806137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:16.875044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1177/2327] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:15:16.886036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:16.887718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:16.945244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40f44-df7a-49b6-aa7e-664797229904 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:16.948950 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:16.949553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:16.949837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:16.950114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:16.959090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:16.960574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158734-4bd2-470c-8997-aacc2f258c23 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:16.970207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1151/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:16 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:17.114223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:17.131355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:17.177727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f408-9257-4937-bbae-e5ce01d6f963 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:17.186796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:17.187437 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:17.187717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:17.188010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] PATH_INFO: `/v3/users/0a7bdf78b4ed4dcb9b0100c97650a1fc` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:17.189202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7bdf78b4ed4dcb9b0100c97650a1fc)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:17.191119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:17.357726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7bdf78b4ed4dcb9b0100c97650a1fc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:17.369596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7bdf78b4ed4dcb9b0100c97650a1fc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:17.376357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7bdf78b4ed4dcb9b0100c97650a1fc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:17.440298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7bdf78b4ed4dcb9b0100c97650a1fc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:17.440969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7bdf78b4ed4dcb9b0100c97650a1fc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:17.447179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1178/2329] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:17 2022] DELETE /identity/v3/users/0a7bdf78b4ed4dcb9b0100c97650a1fc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:17.451786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:17.452098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:17.452371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:17.471388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:17.472647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:17.511386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:17.532130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1152/2330] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:15:17.542572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:17.543973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:17.610721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fe77d-cae7-425f-a009-d3f56321491e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:17.614930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:17.615565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:17.615933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:17.616248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:17.626453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:17.627967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e781ca5-ce1b-4e0b-b7af-d57b1ac9f6c7 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:17.638771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1179/2331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:15:18.152156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:18.153887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:18.167942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500484-5464-4031-8d3c-9e60d8d532d4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:18.176062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:18.176712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:18.176986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:18.178639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] PATH_INFO: `/v3/projects/7ea900be16984f0bb81d41a407ae766d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:18.180234 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea900be16984f0bb81d41a407ae766d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:18.180397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:18.181066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:18.181066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:18.182485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:18.201974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:18.204855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:18.240876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:18.263458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1180/2332] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:15:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:18.276818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:18.278342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:18.295549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea900be16984f0bb81d41a407ae766d', 'request_id': 'req-ae181206-402e-4713-9862-2d510db760b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.349214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b553c-38bd-4e6b-8b00-a7d6ee104a60 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:18.360417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea900be16984f0bb81d41a407ae766d', 'request_id': 'req-ae181206-402e-4713-9862-2d510db760b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.367026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea900be16984f0bb81d41a407ae766d', 'request_id': 'req-ae181206-402e-4713-9862-2d510db760b2'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.378035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] The token cache is being invalidate because project 7ea900be16984f0bb81d41a407ae766d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:18.378329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.378983 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.380550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1153/2333] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:18 2022] DELETE /identity/v3/projects/7ea900be16984f0bb81d41a407ae766d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:18.385024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:18.386338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:18.411831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:18.412469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:18.412746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:18.413016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:18.414796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:18.452347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181206-402e-4713-9862-2d510db760b2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:18.457133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:18.457771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:18.458052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:18.458328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] PATH_INFO: `/v3/users/f8277a3c2b224671b1cf4c5c9cd4b1bf` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:18.459466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8277a3c2b224671b1cf4c5c9cd4b1bf)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:18.461441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:18.474823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:18.476458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:18.485392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1181/2334] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 08:15:18.618940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8277a3c2b224671b1cf4c5c9cd4b1bf'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.639630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8277a3c2b224671b1cf4c5c9cd4b1bf'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.642525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:18.648073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8277a3c2b224671b1cf4c5c9cd4b1bf'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.648853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8277a3c2b224671b1cf4c5c9cd4b1bf'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.714655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0b028775-526a-433e-b85e-5371906a548f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8277a3c2b224671b1cf4c5c9cd4b1bf'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:18.721480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1154/2335] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:18 2022] DELETE /identity/v3/users/f8277a3c2b224671b1cf4c5c9cd4b1bf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:19.255038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:19.285564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53652-fd39-4524-b1ab-878c827dabc8 service swift] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:19.327881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:19.373045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:19.373692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.374041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.374386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] PATH_INFO: `/v3/projects/72302ec7992e4fbb8d04d6a165c26c85` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.375562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72302ec7992e4fbb8d04d6a165c26c85)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:19.377439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:19.508044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72302ec7992e4fbb8d04d6a165c26c85', 'request_id': 'req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:19.517831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72302ec7992e4fbb8d04d6a165c26c85', 'request_id': 'req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:19.524830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72302ec7992e4fbb8d04d6a165c26c85', 'request_id': 'req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:19.583868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] The token cache is being invalidate because project 72302ec7992e4fbb8d04d6a165c26c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:19.584461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:19.585218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-fa39ff76-c28e-46b0-a60e-b3337c2ad33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:19.588282 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1182/2336] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:19 2022] DELETE /identity/v3/projects/72302ec7992e4fbb8d04d6a165c26c85 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:19.592524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.593113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.593113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.615717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:19.616726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:19.688876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1155/2337] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:19.696390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.696905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.697343 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.719180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:19.720471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:19.733177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1183/2338] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:19.734469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:19.745303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf1191-e350-4b0e-b4a4-a2ad04688e56 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:19.752029 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:19.752828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.753114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.753386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.754047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:19.754360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:19.755966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:19.774802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1156/2339] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:15:19.779794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:19.793498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe121eb-cbf3-4df9-9a42-44a6934f2fbe None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:19.798982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:19.800015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.800285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.800570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.804558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:19.808860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:19.899900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1184/2340] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:19 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:19.904758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:19.917280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c58d-c00f-4e4f-81bd-b7a6049ce6fa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:19.988496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:19.989392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:19.989830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:19.990261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:19.991054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:19.993751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.068214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1157/2341] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:19 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:20.071177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.088359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236792b-993d-4516-af61-13b134a403dc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.095609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.098297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.098948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.099592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.101682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.105112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.120716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1185/2342] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:20.121667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.132387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f6ec-4fff-49ea-803e-390bc5537f30 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.139041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.140079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.140582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.141178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.142065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.144106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba486a-9170-438e-8ead-e68f78cc12d8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.161741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.162739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1158/2343] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:20.173335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e31bd-9af1-49b8-b656-27a02969abbf admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.179223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.180044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.180433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.180841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] PATH_INFO: `/v3/projects/12303b140f184ffba28a040257ce0d6c/users/da67845b510442d79b063ab556ce06c9/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.203188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12303b140f184ffba28a040257ce0d6c, user_id=da67845b510442d79b063ab556ce06c9, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.205871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.321791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1186/2344] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:20 2022] PUT /identity/v3/projects/12303b140f184ffba28a040257ce0d6c/users/da67845b510442d79b063ab556ce06c9/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:15:20.333053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.333649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.334026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.363792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] MFA Rules not processed for user `da67845b510442d79b063ab556ce06c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:20.365157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:20.418017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:20.450041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1159/2345] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:20.454270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.530110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:20.542127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141ee1-9653-40b7-9873-a08abd9f6bc2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.547263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.547932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.548243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.548519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.549158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.552461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.646987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1187/2346] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:20 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:20.648382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.662382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b2d6-a6b1-44c7-b1c2-7724b21fc16f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.743242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.744035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.744511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.744851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.745564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.747794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.853221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1160/2347] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:20 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:15:20.857270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.868648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecaebc-380a-4c41-a888-6f7bcc251d43 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.873431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.878125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.878125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.878125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.878125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.878125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:20.889080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1188/2348] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:20.893288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:20.910322 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3af1b-31ef-40b0-8333-a7cd37b0d4e4 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:20.915905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:20.916601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:20.916913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:20.917372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] PATH_INFO: `/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5/users/c0978baf0dcd4f81932e0b3b577f1fc1/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:20.935521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5d8879bf904c1aba1ef2e726e516f5, user_id=c0978baf0dcd4f81932e0b3b577f1fc1, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:20.938354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:21.036253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1161/2349] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:20 2022] PUT /identity/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5/users/c0978baf0dcd4f81932e0b3b577f1fc1/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:21.041076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:21.054277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c4e-7abb-4ff9-b549-15c50e4c7658 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:21.120908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:21.121735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:21.122124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:21.122504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:21.123270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:21.125183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665fc31-a9cd-4f1d-af67-0a65eb9e9048 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:21.136673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1189/2350] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:15:21.141094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:21.154894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdf76-1c73-48a3-8764-75ce57920399 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:21.159833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:21.160634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:21.160975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:21.161328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] PATH_INFO: `/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5/users/c0978baf0dcd4f81932e0b3b577f1fc1/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:21.163407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5d8879bf904c1aba1ef2e726e516f5, user_id=c0978baf0dcd4f81932e0b3b577f1fc1, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:21.166847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:21.178459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1162/2351] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:21 2022] PUT /identity/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5/users/c0978baf0dcd4f81932e0b3b577f1fc1/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:21.190468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:21.190758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:21.191036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:21.224186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] MFA Rules not processed for user `c0978baf0dcd4f81932e0b3b577f1fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:21.225436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:21.310022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1190/2352] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:21.322253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:21.324455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:21.401501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb4fb4-eccc-4285-afcf-8c6ca5822435 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:21.405502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:21.406190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:21.406723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:21.407166 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:21.419484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:21.421214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:21.436362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1163/2353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:21.908964 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:21.921524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1879-7150-4493-9c17-9a93a70a62d2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:21.926539 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:21.927159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:21.927425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:21.927701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:21.985018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:21.998557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:22.002150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65081632-398d-43dc-856a-af5034a8c7a9 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:22.011159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1191/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:15:25.703523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:25.751147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:25.778348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11999-b4cc-48af-9618-ee47567c57cf service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:25.785054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:25.785707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:25.785980 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:25.786287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] PATH_INFO: `/v3/users/da67845b510442d79b063ab556ce06c9` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:25.787543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da67845b510442d79b063ab556ce06c9)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:25.789498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:26.018825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da67845b510442d79b063ab556ce06c9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:26.033989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da67845b510442d79b063ab556ce06c9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:26.042977 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da67845b510442d79b063ab556ce06c9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:26.044095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da67845b510442d79b063ab556ce06c9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:26.122529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da67845b510442d79b063ab556ce06c9'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:26.132301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1164/2355] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:25 2022] DELETE /identity/v3/users/da67845b510442d79b063ab556ce06c9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:26.139953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:26.141348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:26.141348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:26.163001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:26.164231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:26.267852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:26.269683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:26.278077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1192/2356] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:26.362154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee8ab8-a861-4c96-a16e-4424ae16bc8c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:26.374430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:26.375062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:26.375348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:26.375629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:26.388594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:26.391644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:26.403272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1165/2357] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:26.890481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:26.890481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:26.910864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65193f02-ec3c-4565-8519-bfa7f3aac167 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:26.925044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:26.925044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:26.925044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:26.925044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] PATH_INFO: `/v3/projects/12303b140f184ffba28a040257ce0d6c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:26.926704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12303b140f184ffba28a040257ce0d6c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:26.929911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:27.054479 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12303b140f184ffba28a040257ce0d6c', 'request_id': 'req-69c13740-af0e-4741-980e-f0218d97ab75'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.061606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12303b140f184ffba28a040257ce0d6c', 'request_id': 'req-69c13740-af0e-4741-980e-f0218d97ab75'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.071220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12303b140f184ffba28a040257ce0d6c', 'request_id': 'req-69c13740-af0e-4741-980e-f0218d97ab75'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.140164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] The token cache is being invalidate because project 12303b140f184ffba28a040257ce0d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:27.140164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.140164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.141654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1193/2358] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:26 2022] DELETE /identity/v3/projects/12303b140f184ffba28a040257ce0d6c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:27.145959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:27.157937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499060-cbcc-43c7-9be3-70a99a40ac95 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:27.221876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:27.228802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:27.235116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:27.235116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:27.235116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] PATH_INFO: `/v3/users/c0978baf0dcd4f81932e0b3b577f1fc1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:27.235116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0978baf0dcd4f81932e0b3b577f1fc1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:27.235941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:27.423616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0978baf0dcd4f81932e0b3b577f1fc1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.443872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0978baf0dcd4f81932e0b3b577f1fc1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.453347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0978baf0dcd4f81932e0b3b577f1fc1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.456444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0978baf0dcd4f81932e0b3b577f1fc1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.529772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-078b2388-9924-41be-a63e-c41e85a9bdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0978baf0dcd4f81932e0b3b577f1fc1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:27.537582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1166/2359] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:27 2022] DELETE /identity/v3/users/c0978baf0dcd4f81932e0b3b577f1fc1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:28.169519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:28.170989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:28.185293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13740-af0e-4741-980e-f0218d97ab75 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:28.260300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:28.265601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.265893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.266182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] PATH_INFO: `/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.268450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5d8879bf904c1aba1ef2e726e516f5)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:28.270407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:28.286980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:28.387515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5d8879bf904c1aba1ef2e726e516f5', 'request_id': 'req-88ebceb0-efba-4b26-99b3-62195a92af13'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:28.394747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5d8879bf904c1aba1ef2e726e516f5', 'request_id': 'req-88ebceb0-efba-4b26-99b3-62195a92af13'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:28.403543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5d8879bf904c1aba1ef2e726e516f5', 'request_id': 'req-88ebceb0-efba-4b26-99b3-62195a92af13'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:28.464126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] The token cache is being invalidate because project 2e5d8879bf904c1aba1ef2e726e516f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:28.464647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:28.465415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-88ebceb0-efba-4b26-99b3-62195a92af13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:28.467143 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1194/2360] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:28 2022] DELETE /identity/v3/projects/2e5d8879bf904c1aba1ef2e726e516f5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:28.472255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.473091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.476338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.493938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:28.495324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:28.573739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1167/2361] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:28.582882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.583165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.583438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.616367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:28.621073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:28.630386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1195/2362] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:28.635187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:28.650227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d20e1c-0151-475c-9aff-6a86de29a46e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:28.655791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:28.659702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.660010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.660306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.661312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:28.661508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:28.665032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:28.680153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1168/2363] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:15:28.684128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:28.701799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133a35-3b93-446e-a100-bcaf50b4f98b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:28.709956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:28.710581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.710860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.711146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.711773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:28.713713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:28.818325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1196/2364] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:28.825022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:28.835936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb051c-96d0-4616-bc27-9408992bb95f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:28.910224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383db157-d154-4e29-b669-63244957b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:28.910908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db157-d154-4e29-b669-63244957b65e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:28.911189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db157-d154-4e29-b669-63244957b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:28.911465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db157-d154-4e29-b669-63244957b65e admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:28.912210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db157-d154-4e29-b669-63244957b65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:28.914159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db157-d154-4e29-b669-63244957b65e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:28.924692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:29.093463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1169/2365] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:28 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:29.097703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.108110 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1bfad-353c-4911-bc1b-d4afc5d31d33 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.112615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.113208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.113621 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.113983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.114572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.116194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.126937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1197/2366] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:29.130971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383db157-d154-4e29-b669-63244957b65e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.141781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383db157-d154-4e29-b669-63244957b65e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.146500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.147115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.147379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.147764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.148531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.150145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94210ba3-e73f-4d2b-9980-38b0c8d1c2cd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.161077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1170/2367] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:29.165435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.175492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862f32-b685-4443-a0fd-eb36ab39a4b1 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.180548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.181193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.181476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.181754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] PATH_INFO: `/v3/projects/8d4143372ada4f3682f8bd3c5e48521a/users/38d4b71a6b194f9caf935bc7fda9bbf3/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.201054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4143372ada4f3682f8bd3c5e48521a, user_id=38d4b71a6b194f9caf935bc7fda9bbf3, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.203692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.304360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1198/2368] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:29 2022] PUT /identity/v3/projects/8d4143372ada4f3682f8bd3c5e48521a/users/38d4b71a6b194f9caf935bc7fda9bbf3/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:29.316688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.316914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.317193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.347584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] MFA Rules not processed for user `38d4b71a6b194f9caf935bc7fda9bbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:29.348785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:29.421755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1171/2369] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:29.426189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.489919 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1ce05-5e47-40c8-8e57-3cc1c7f55a2c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.494553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.495150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.495426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.495698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.496357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.499099 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.596475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1199/2370] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:29 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:29.600427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.611734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520ad4-6ab2-48b4-a979-a4ba3fbe7f1d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.665969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.666660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.666941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.667211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.667868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.670363 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.738240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1172/2371] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:29 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:29.742277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.753258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa54a-201e-4c0c-a541-9597466cc35d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.758115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.758713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.759072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.759381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.760035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.761653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.773835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1200/2372] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:29.778183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.788720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c5b39-eaf9-49f1-87d8-36bb81202d8f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.790879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.792395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:29.794432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.795269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.795470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.795777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] PATH_INFO: `/v3/projects/aebbf3f424d8468d9d63697087107b7d/users/2ba083bc80fd4c2eb6f8c5b1463fb579/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.807473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:29.814991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebbf3f424d8468d9d63697087107b7d, user_id=2ba083bc80fd4c2eb6f8c5b1463fb579, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.817857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.870005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e9ffd-af8c-4022-9144-2986863793c5 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:29.876402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:29.877186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:29.877463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:29.877755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:29.879660 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:29.938261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1173/2373] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:29 2022] PUT /identity/v3/projects/aebbf3f424d8468d9d63697087107b7d/users/2ba083bc80fd4c2eb6f8c5b1463fb579/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:29.940201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.941493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:29.943128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:29.955008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1201/2374] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:15:29.989929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:29.995884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:29.997985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:30.012593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf71ca-002c-4432-8321-a0ebdddb248b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:30.017913 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:30.018529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.023485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.023485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.023485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:30.023485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:30.035846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1174/2375] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:30.036943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:30.048781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c893-d77f-49ad-9a5f-1213d8adda23 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:30.054049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:30.054953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.055342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.055700 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] PATH_INFO: `/v3/projects/aebbf3f424d8468d9d63697087107b7d/users/2ba083bc80fd4c2eb6f8c5b1463fb579/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.057752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebbf3f424d8468d9d63697087107b7d, user_id=2ba083bc80fd4c2eb6f8c5b1463fb579, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:30.060232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21904b3-d5f8-417b-8043-f553d2983ef1 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:30.061271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32147b9-ab95-4bf9-973c-1da21e8db221 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:30.072414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1175/2376] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:30 2022] PUT /identity/v3/projects/aebbf3f424d8468d9d63697087107b7d/users/2ba083bc80fd4c2eb6f8c5b1463fb579/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:30.083132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.083443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.083688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.114066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] MFA Rules not processed for user `2ba083bc80fd4c2eb6f8c5b1463fb579`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:30.115290 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:30.117630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:30.118238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.118518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.118790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.120678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:30.133612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:30.135046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:30.145202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1202/2377] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:15:30.202565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1176/2378] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:30.214721 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:30.218301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:30.225837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:30.285506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5dc28-e7a4-4528-9ffa-549ef2a2b711 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:30.344435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:30.345060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.345863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.346140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.358179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:30.359617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9999c-939f-40c6-b8c1-b7f82a8d81b6 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:30.369854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1203/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:30.449092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:30.521216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2eb8b-a72a-45cd-a702-604bb8334f22 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:30.528995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:30.529880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.530425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.530801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] PATH_INFO: `/v3/users/38d4b71a6b194f9caf935bc7fda9bbf3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.532407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d4b71a6b194f9caf935bc7fda9bbf3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:30.534649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:30.714048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d4b71a6b194f9caf935bc7fda9bbf3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:30.715167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:30.733771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d4b71a6b194f9caf935bc7fda9bbf3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:30.743897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d4b71a6b194f9caf935bc7fda9bbf3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:30.749202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d4b71a6b194f9caf935bc7fda9bbf3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:30.836020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d4b71a6b194f9caf935bc7fda9bbf3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:30.843270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1177/2380] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:30 2022] DELETE /identity/v3/users/38d4b71a6b194f9caf935bc7fda9bbf3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:30.848006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:30.848369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:30.848715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:30.868934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:30.870705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:30.932380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1204/2381] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:30.943140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:30.944538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:31.006778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aea00-080b-4f24-905b-426ebce7fc7b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:31.010394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:31.010999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:31.011272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:31.011545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:31.021371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:31.022854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:31.033874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1178/2382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:31.447268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:31.448913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:31.462266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c56b-dc39-4b87-9f96-3c288cfd55cf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:31.467842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:31.468542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:31.468825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:31.469100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] PATH_INFO: `/v3/projects/8d4143372ada4f3682f8bd3c5e48521a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:31.470258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4143372ada4f3682f8bd3c5e48521a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:31.472269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:31.573869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4143372ada4f3682f8bd3c5e48521a', 'request_id': 'req-6970d805-8869-4443-8925-ab90470d6854'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.581246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4143372ada4f3682f8bd3c5e48521a', 'request_id': 'req-6970d805-8869-4443-8925-ab90470d6854'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.586814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:31.588397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4143372ada4f3682f8bd3c5e48521a', 'request_id': 'req-6970d805-8869-4443-8925-ab90470d6854'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.651819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] The token cache is being invalidate because project 8d4143372ada4f3682f8bd3c5e48521a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:31.652619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.653344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.654844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1205/2383] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:31 2022] DELETE /identity/v3/projects/8d4143372ada4f3682f8bd3c5e48521a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:31.659000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:31.668650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea95c-75c4-457e-8f59-7104d0d0dfec service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:31.730717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:31.732000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:31.732302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:31.732684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] PATH_INFO: `/v3/users/2ba083bc80fd4c2eb6f8c5b1463fb579` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:31.733854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba083bc80fd4c2eb6f8c5b1463fb579)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:31.735890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:31.894196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba083bc80fd4c2eb6f8c5b1463fb579'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.906530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba083bc80fd4c2eb6f8c5b1463fb579'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.910881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:31.913778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba083bc80fd4c2eb6f8c5b1463fb579'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:31.914452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba083bc80fd4c2eb6f8c5b1463fb579'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.011922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59d0c141-e55a-40f3-990a-be308577ce1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba083bc80fd4c2eb6f8c5b1463fb579'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.020095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1179/2384] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:31 2022] DELETE /identity/v3/users/2ba083bc80fd4c2eb6f8c5b1463fb579 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:32.430813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:32.432542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:32.446830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970d805-8869-4443-8925-ab90470d6854 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:32.504783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:32.505439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:32.505675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:32.505946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] PATH_INFO: `/v3/projects/aebbf3f424d8468d9d63697087107b7d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:32.507036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebbf3f424d8468d9d63697087107b7d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:32.508969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:32.636249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebbf3f424d8468d9d63697087107b7d', 'request_id': 'req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.643017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebbf3f424d8468d9d63697087107b7d', 'request_id': 'req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.648941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebbf3f424d8468d9d63697087107b7d', 'request_id': 'req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.720956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] The token cache is being invalidate because project aebbf3f424d8468d9d63697087107b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:32.721250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.721895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ee20ad62-dc1e-4dfd-8a3f-487a69b26cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:32.723392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1206/2385] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:32 2022] DELETE /identity/v3/projects/aebbf3f424d8468d9d63697087107b7d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:32.728286 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:32.728574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:32.728851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:32.748341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:32.749572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:32.813248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1180/2386] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:32.821076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:32.832335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:32.832335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:32.843967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:32.845194 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:32.853286 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1207/2387] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:32.857755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:32.867340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5188a-560a-4a43-ac95-cab624eaec18 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:32.871861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:32.873155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:32.873449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:32.873853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:32.874370 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:32.874679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:32.876423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:32.889782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1181/2388] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:15:32.894039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:32.905379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9095a-03b5-45de-ae69-efd8f8ec120d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:32.910765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:32.911452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:32.911915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:32.912297 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:32.913016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:32.915050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.003572 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1208/2389] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:32 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:33.007641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.019835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f236be3-a555-4f9f-ba7a-97910ddb3aee admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.082691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.083389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.083670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.083940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.084679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.086602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.207650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1182/2390] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:33 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:33.211831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.223181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6832d-96f0-440a-a731-f00ba7af850e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.227688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.228329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.228610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.228880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.229508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.231076 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.242087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1209/2391] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:33.246102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.260414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db352c-cb16-4b9a-a1e6-1bbd83ccebb3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.265868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.266677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.267026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.267368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.268230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.269838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479313-cde5-4243-ac2d-3dbf3ec5a6d2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.281762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1183/2392] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:33.285790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.296466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820766-1c1b-4327-95d8-e456064fb396 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.300957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.301601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.301880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.302157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] PATH_INFO: `/v3/projects/dbfd56580f8449aaa246e10d09e8e643/users/c360df6f244247e2bd020e39e3c17448/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.318008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfd56580f8449aaa246e10d09e8e643, user_id=c360df6f244247e2bd020e39e3c17448, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.320657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.382959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1210/2393] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:33 2022] PUT /identity/v3/projects/dbfd56580f8449aaa246e10d09e8e643/users/c360df6f244247e2bd020e39e3c17448/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:33.395061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.395512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.395861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.426067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] MFA Rules not processed for user `c360df6f244247e2bd020e39e3c17448`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:33.427269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:33.469952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:33.497004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1184/2394] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:33.501526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.520855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:33.567117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b8bb-b63e-4957-97db-d0b30f076072 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.571795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.572436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.572715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.572988 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.573665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.576485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.683801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1211/2395] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:33 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:15:33.687330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.697910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22867f20-41aa-488f-9fcd-855bf0300694 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.758544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.759263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.759614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.759901 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.760592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.762617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.855891 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1185/2396] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:33 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:33.857977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.868714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422471-13d8-4a03-8bbd-ad0dbef98aea admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.873855 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.874448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.876887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.876887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.876887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.877294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.888281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1212/2397] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:15:33.892386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.902845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b776ca-bd5a-4857-9e35-3be0e9d4f92f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.908313 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.908856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.909174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.909449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.910085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.911685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f08ba-cb88-4fa1-b10e-cb7d3015711c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:33.924190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1186/2398] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:33.928289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:33.939257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18a412-d683-4295-b12e-3cd30d20c676 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:33.944954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:33.946023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:33.946277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:33.946545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] PATH_INFO: `/v3/projects/2f40bc9928bd4060b96342bedf440a0d/users/1fad71d42c79486c81d7558fffb8c6ed/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:33.962560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f40bc9928bd4060b96342bedf440a0d, user_id=1fad71d42c79486c81d7558fffb8c6ed, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:33.965597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.052928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1213/2399] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:33 2022] PUT /identity/v3/projects/2f40bc9928bd4060b96342bedf440a0d/users/1fad71d42c79486c81d7558fffb8c6ed/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:15:34.064296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.064590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.064871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.095565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] MFA Rules not processed for user `1fad71d42c79486c81d7558fffb8c6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:34.096945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:34.162526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1187/2400] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:34.167345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.230011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cffc0-44a7-462d-9fc0-4234434d0c4e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.235312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.235913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.236265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.240537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.240537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.240537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.322899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1214/2401] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:34.327328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.339127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448471-a72b-4065-894d-bf29b654ed54 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.394808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:34.404625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.405839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.406142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.406523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.407231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.409202 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.489743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1188/2402] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:34 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:34.493449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.505344 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9950d0-62ec-4808-8408-ae0b63e389e7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.510352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.511027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.511313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.511646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.512306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.518446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.525432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1215/2403] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:15:34.529944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.540701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c97bf-8b5a-4cb4-8d49-646b684af9ba admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.545492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.546879 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.547154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.547447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] PATH_INFO: `/v3/projects/5f410fd1c5e0468490e1adf339e3f137/users/c5e163cbadeb4866b0b0e76ee7cbfa11/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.563481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f410fd1c5e0468490e1adf339e3f137, user_id=c5e163cbadeb4866b0b0e76ee7cbfa11, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.566250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.647402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1189/2404] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:34 2022] PUT /identity/v3/projects/5f410fd1c5e0468490e1adf339e3f137/users/c5e163cbadeb4866b0b0e76ee7cbfa11/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:15:34.651561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.662482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41b7c-fb2a-477f-bdda-cc530dc2bbe3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.705641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:34.723651 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.724305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.724610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.724886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.725521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.727120 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6340-eb59-47dc-8b47-2cb72456709a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.738458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1216/2405] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:34.741941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.753070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9b7cc-43ea-4515-82fa-25833dd3bca3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.757698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.758361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.758630 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.759237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] PATH_INFO: `/v3/projects/5f410fd1c5e0468490e1adf339e3f137/users/c5e163cbadeb4866b0b0e76ee7cbfa11/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.760968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f410fd1c5e0468490e1adf339e3f137, user_id=c5e163cbadeb4866b0b0e76ee7cbfa11, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.763565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.777473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1190/2406] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:34 2022] PUT /identity/v3/projects/5f410fd1c5e0468490e1adf339e3f137/users/c5e163cbadeb4866b0b0e76ee7cbfa11/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:34.787749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.788074 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.796334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.818658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] MFA Rules not processed for user `c5e163cbadeb4866b0b0e76ee7cbfa11`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:34.819849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:34.890006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1217/2407] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:34.900579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:34.902306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:34.962790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948664f-59b2-4d9e-8925-fc9125ad74ea admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:34.966466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:34.967070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:34.967343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:34.967662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:34.976964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:34.978378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:34.988503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1191/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:35.211825 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:35.213290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:35.286835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69690c88-872c-4e40-8fac-eedb385a7808 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:35.292354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:35.292956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:35.293239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:35.293501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:35.295229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:35.309525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:35.311420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:35.327682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1218/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:35.490108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:35.492735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:35.568673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fe074-b032-45bf-a89f-e8e8d0c4cb0a service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:35.572293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:35.572897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:35.573173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:35.573471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:35.575194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:35.585459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:35.586867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:35.595888 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1192/2410] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:36.236966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:36.238978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:36.252430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b32359-469f-4f7e-9b3f-879d1369d373 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:36.256839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:36.257449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:36.257729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:36.258004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:36.325727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:36.341199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:36.344001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee887fb2-21fe-408a-bef2-9dc262321343 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:36.354154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1219/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:36.370114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:36.374750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:36.428988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:36.450350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4076-8b42-4754-a542-52efd63ba6ee service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:36.455826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:36.456650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:36.457001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:36.457448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:36.459149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:36.470920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:36.472567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:36.484134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1193/2412] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:39.628438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:39.628949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:39.629044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:39.650007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:39.651294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:39.718164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1220/2413] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:15:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:39.728588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:39.730667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:39.806849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afb80a-d352-47f0-97c0-4f4bed887260 service placement] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:39.813628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:39.814291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:39.815416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:39.815416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:39.823133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:39.824743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:39.833101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1194/2414] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:15:41.678296 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:41.688001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304db4-16cd-4999-8c65-e5614c6465e0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:41.692104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:41.692742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:41.693022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:41.693293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:41.775060 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:41.776554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4968f9-5533-4301-a852-a70890f07cf2 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:41.789806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1221/2415] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:45.730677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:45.797641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9abed-e2d9-46c0-b6b3-0be154d3a8d9 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:45.806019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:45.806019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:45.806019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:45.806019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] PATH_INFO: `/v3/users/c360df6f244247e2bd020e39e3c17448` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:45.808476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c360df6f244247e2bd020e39e3c17448)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:45.809095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:45.968762 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c360df6f244247e2bd020e39e3c17448'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:45.983750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c360df6f244247e2bd020e39e3c17448'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:45.991082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:45.994509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c360df6f244247e2bd020e39e3c17448'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:45.995264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c360df6f244247e2bd020e39e3c17448'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.046218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c360df6f244247e2bd020e39e3c17448'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.052919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1195/2416] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:45 2022] DELETE /identity/v3/users/c360df6f244247e2bd020e39e3c17448 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:46.057796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:46.058281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:46.058393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:46.077412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:46.078646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:46.151160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1222/2417] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:15:46.161437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:46.163030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:46.236673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f0903-ff8d-4a14-b055-a25e529e116d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:46.241016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:46.241723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:46.242086 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:46.242362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:46.254026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:46.255513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:46.266240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1196/2418] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:46.678593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:46.680696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:46.707391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0575-b14e-41f7-8d33-a9c9464c53ec None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:46.721832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:46.722494 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:46.722780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:46.723056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] PATH_INFO: `/v3/projects/dbfd56580f8449aaa246e10d09e8e643` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:46.724279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfd56580f8449aaa246e10d09e8e643)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:46.727073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:46.758293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:46.866525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfd56580f8449aaa246e10d09e8e643', 'request_id': 'req-a1eebd64-116a-46dc-a7f3-c82da6d5012c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.874116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfd56580f8449aaa246e10d09e8e643', 'request_id': 'req-a1eebd64-116a-46dc-a7f3-c82da6d5012c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.881880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfd56580f8449aaa246e10d09e8e643', 'request_id': 'req-a1eebd64-116a-46dc-a7f3-c82da6d5012c'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.943529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] The token cache is being invalidate because project dbfd56580f8449aaa246e10d09e8e643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:46.943797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.944405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:46.945939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1223/2419] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:46 2022] DELETE /identity/v3/projects/dbfd56580f8449aaa246e10d09e8e643 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:46.949955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:46.960720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3712289-9eb4-4b62-a010-68940f534eab service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:47.070703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:47.071354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:47.071633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:47.071920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] PATH_INFO: `/v3/users/1fad71d42c79486c81d7558fffb8c6ed` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:47.073276 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fad71d42c79486c81d7558fffb8c6ed)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:47.075341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:47.307505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fad71d42c79486c81d7558fffb8c6ed'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:47.332169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fad71d42c79486c81d7558fffb8c6ed'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:47.339684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fad71d42c79486c81d7558fffb8c6ed'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:47.340596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fad71d42c79486c81d7558fffb8c6ed'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:47.658499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fad71d42c79486c81d7558fffb8c6ed'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:47.666028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1197/2420] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:46 2022] DELETE /identity/v3/users/1fad71d42c79486c81d7558fffb8c6ed => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:48.205788 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:48.208552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:48.249532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eebd64-116a-46dc-a7f3-c82da6d5012c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:48.355681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:48.356387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:48.356673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:48.356982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] PATH_INFO: `/v3/projects/2f40bc9928bd4060b96342bedf440a0d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:48.358287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f40bc9928bd4060b96342bedf440a0d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:48.360877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:48.462162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f40bc9928bd4060b96342bedf440a0d', 'request_id': 'req-02325054-47ff-42cd-ae5c-ae6667d19bf7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.471790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f40bc9928bd4060b96342bedf440a0d', 'request_id': 'req-02325054-47ff-42cd-ae5c-ae6667d19bf7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.480399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f40bc9928bd4060b96342bedf440a0d', 'request_id': 'req-02325054-47ff-42cd-ae5c-ae6667d19bf7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.571448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] The token cache is being invalidate because project 2f40bc9928bd4060b96342bedf440a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:48.575767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.575767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.575767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1224/2421] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:48 2022] DELETE /identity/v3/projects/2f40bc9928bd4060b96342bedf440a0d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:48.578544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:48.580867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:48.593584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb3e9-1c95-48e5-88a7-c2b9958c8dcb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:48.598270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:48.660028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:48.660682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:48.660986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:48.661263 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] PATH_INFO: `/v3/users/c5e163cbadeb4866b0b0e76ee7cbfa11` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:48.662385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e163cbadeb4866b0b0e76ee7cbfa11)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:48.664345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:48.839758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e163cbadeb4866b0b0e76ee7cbfa11'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.852937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e163cbadeb4866b0b0e76ee7cbfa11'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.859930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e163cbadeb4866b0b0e76ee7cbfa11'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.861097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e163cbadeb4866b0b0e76ee7cbfa11'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.920507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0f5b23cc-6366-4b9a-a0c2-98adb7215f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e163cbadeb4866b0b0e76ee7cbfa11'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:48.927451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1198/2422] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:15:48 2022] DELETE /identity/v3/users/c5e163cbadeb4866b0b0e76ee7cbfa11 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:49.312998 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:49.316277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:49.334063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02325054-47ff-42cd-ae5c-ae6667d19bf7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:49.396604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:49.417234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:49.417879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:49.418156 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:49.418434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] PATH_INFO: `/v3/projects/5f410fd1c5e0468490e1adf339e3f137` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:49.419615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f410fd1c5e0468490e1adf339e3f137)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:49.421636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:49.535910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f410fd1c5e0468490e1adf339e3f137', 'request_id': 'req-835f6799-6c95-413c-9b5c-93ddeac05832'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:49.543548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f410fd1c5e0468490e1adf339e3f137', 'request_id': 'req-835f6799-6c95-413c-9b5c-93ddeac05832'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:49.551869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f410fd1c5e0468490e1adf339e3f137', 'request_id': 'req-835f6799-6c95-413c-9b5c-93ddeac05832'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:49.657633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] The token cache is being invalidate because project 5f410fd1c5e0468490e1adf339e3f137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:15:49.657928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:49.658723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-835f6799-6c95-413c-9b5c-93ddeac05832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:15:49.660304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1225/2423] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:15:49 2022] DELETE /identity/v3/projects/5f410fd1c5e0468490e1adf339e3f137 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:49.672618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:49.673723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:49.673853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:49.697601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:49.698840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:49.773540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1199/2424] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:49.839398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:49.841653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:49.841653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:49.863950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:49.865199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:49.875232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1226/2425] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:49.880594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:49.894391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50e53-4dca-4e48-81e5-bf137a3c039f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:49.900956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:49.902182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:49.902465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:49.902745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:49.903407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:15:49.903709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:49.905358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:49.918641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1200/2426] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:15:49.923051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:49.933671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802d6c-0b25-4c52-bd42-77d19e597d89 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:49.939353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:49.940419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:49.940753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:49.941023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:49.941875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:49.945259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.084020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1227/2427] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:49 2022] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:15:50.088261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.099392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70ddf-c683-4ea9-ada6-6a06a44b7ab7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.112694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:50.175649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.176478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.176754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.177027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.177665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.180364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.298915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1201/2428] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:50 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:15:50.303199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.313473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad136bd6-449b-429f-a49c-5a316e645b91 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.319045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.319642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.319923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.320228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.320861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.322435 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.333256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1228/2429] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:50.337185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.347123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c311e4-5009-4528-97c6-9fd880f54e18 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.352712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.353241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.353524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.353801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.354479 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.356128 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261ff0-52ad-418a-af68-a2cc2008950d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.366909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1202/2430] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:50.371249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.381815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f0b9-78b5-40e5-9b44-afbef0b24215 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.386368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.387015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.387289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.387557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] PATH_INFO: `/v3/projects/07f052b012a24489b317f5a0ecf032c4/users/3b8e86785fe14bce88523ff18df00395/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.402264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f052b012a24489b317f5a0ecf032c4, user_id=3b8e86785fe14bce88523ff18df00395, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.404987 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.475584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1229/2431] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:50 2022] PUT /identity/v3/projects/07f052b012a24489b317f5a0ecf032c4/users/3b8e86785fe14bce88523ff18df00395/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:50.487672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.487985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.488271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.518193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] MFA Rules not processed for user `3b8e86785fe14bce88523ff18df00395`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:50.519441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:50.587011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1203/2432] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:50.591723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.664326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fb1fe-b0a5-48d4-ad8f-bda03d82f566 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.670530 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.671209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.671613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.671939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.672674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.675280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.690810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:50.795304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1230/2433] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:15:50 2022] POST /identity/v3/projects => generated 409 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:15:50.798732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.809211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283005f-4832-481e-be64-4aec9ee32be9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.866657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.867312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.867596 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.867876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.868551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.870474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:50.975707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1204/2434] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:15:50 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:15:50.977035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:50.988202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad3ec-440c-407a-adaf-abccb2a12458 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:50.992803 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:50.993403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:50.993675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:50.993942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:50.994571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:50.996181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:51.006568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1231/2435] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:51.010745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:51.022022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f0f8f-1f32-4486-ac7d-67e247dd5120 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:51.026575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:51.027228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.027502 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.027777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] PATH_INFO: `/v3/projects/e3cbb09497964068b158ff361556251a/users/64ee2e584c8b4e2eafb3eb8384874079/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:51.040623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:51.044940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cbb09497964068b158ff361556251a, user_id=64ee2e584c8b4e2eafb3eb8384874079, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:51.047648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:51.154973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1205/2436] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:51 2022] PUT /identity/v3/projects/e3cbb09497964068b158ff361556251a/users/64ee2e584c8b4e2eafb3eb8384874079/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:51.159665 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:51.169779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9169a-43f1-45b8-a1dc-b2d566f4b196 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:51.226513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:51.227034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.227438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.227720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:51.228456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:51.230036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5276-377e-4e3f-89bb-0b90f31801e6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:51.245364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1232/2437] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:15:51.251594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:51.268377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d5ee-799a-4dd2-b8b8-3cfb61197575 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:51.277782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:51.278474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.278758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.279036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] PATH_INFO: `/v3/projects/e3cbb09497964068b158ff361556251a/users/64ee2e584c8b4e2eafb3eb8384874079/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:51.292592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cbb09497964068b158ff361556251a, user_id=64ee2e584c8b4e2eafb3eb8384874079, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:51.295188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:51.309073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1206/2438] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:15:51 2022] PUT /identity/v3/projects/e3cbb09497964068b158ff361556251a/users/64ee2e584c8b4e2eafb3eb8384874079/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:15:51.320856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.321404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.321404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:51.364869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] MFA Rules not processed for user `64ee2e584c8b4e2eafb3eb8384874079`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:51.366232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:51.444774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1233/2439] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:15:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:15:51.530374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:51.533557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:51.602442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee21a3-095e-4d8f-9bd6-1da0cb6b47d8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:51.607015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:51.607698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.608109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.608474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:51.619272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:51.620746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:51.630653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1207/2440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:51.929362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:51.939827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e66e-1d5a-4a12-8518-f7ea2b2f4b00 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:51.943354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:51.943950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:51.944266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:51.944535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:52.002273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:52.003735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6c83-77e9-4188-8f5a-2f18743e3df3 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:52.013046 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1234/2441] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:57.299155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:57.300626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:57.392347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9854b-b890-452a-a8ec-5b0c561437e3 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:57.398522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:57.399185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:57.399475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:57.399752 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:57.402365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:57.416569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:57.418197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:57.446500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1208/2442] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:15:57.561940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:57.561940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:57.562655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:57.574542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:57.600266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:15:57.601827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:57.677736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1235/2443] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:15:57.701183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:15:57.703297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:15:57.775325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54801454-ed94-4741-aec1-c97cf0d910b7 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:15:57.780409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:15:57.781673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:15:57.781673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:15:57.781673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:15:57.786741 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:15:57.790751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:15:57.793431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b33d4-98fe-4034-97f6-0b38ea1ededd service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:15:57.802989 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1209/2444] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:16:00.060415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:00.124393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4ebc-b987-40f6-a2db-7f44b089d29e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:00.129885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:00.130511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:00.130794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:00.131066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] PATH_INFO: `/v3/users/3b8e86785fe14bce88523ff18df00395` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:00.132206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8e86785fe14bce88523ff18df00395)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:00.134148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:00.329036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8e86785fe14bce88523ff18df00395'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:00.342393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8e86785fe14bce88523ff18df00395'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:00.350965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8e86785fe14bce88523ff18df00395'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:00.464021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8e86785fe14bce88523ff18df00395'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:00.464681 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8e86785fe14bce88523ff18df00395'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:00.471884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1236/2445] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:00 2022] DELETE /identity/v3/users/3b8e86785fe14bce88523ff18df00395 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:00.476876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:00.477378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:00.477492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:00.496695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:00.497956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:00.568317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1210/2446] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:00.578117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:00.579542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:00.612806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:00.641522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633dfc5-8cae-4153-b2ae-42775024e94b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:00.646304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:00.646925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:00.647207 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:00.647484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:00.657487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:00.659253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:00.673729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1237/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:01.082701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:01.084255 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:01.097429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626df6-0f04-4300-b8b6-5d334b725e76 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:01.102918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:01.103818 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:01.104578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:01.105654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] PATH_INFO: `/v3/projects/07f052b012a24489b317f5a0ecf032c4` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:01.114385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f052b012a24489b317f5a0ecf032c4)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:01.115485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:01.222270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f052b012a24489b317f5a0ecf032c4', 'request_id': 'req-839548a7-0e93-47ab-8db6-df860ea86d63'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.292463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f052b012a24489b317f5a0ecf032c4', 'request_id': 'req-839548a7-0e93-47ab-8db6-df860ea86d63'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.299890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f052b012a24489b317f5a0ecf032c4', 'request_id': 'req-839548a7-0e93-47ab-8db6-df860ea86d63'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.310688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] The token cache is being invalidate because project 07f052b012a24489b317f5a0ecf032c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:01.310835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.311469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.313022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1211/2448] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:01 2022] DELETE /identity/v3/projects/07f052b012a24489b317f5a0ecf032c4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:01.317389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:01.326767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7559e-8e34-4d33-9dc1-9be586aa6c39 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:01.384832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:01.385382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:01.385662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:01.385934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] PATH_INFO: `/v3/users/64ee2e584c8b4e2eafb3eb8384874079` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:01.387034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ee2e584c8b4e2eafb3eb8384874079)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:01.389033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:01.533869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ee2e584c8b4e2eafb3eb8384874079'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.545797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ee2e584c8b4e2eafb3eb8384874079'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.553471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ee2e584c8b4e2eafb3eb8384874079'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.605522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ee2e584c8b4e2eafb3eb8384874079'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.608963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ee2e584c8b4e2eafb3eb8384874079'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:01.612658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1238/2449] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:01 2022] DELETE /identity/v3/users/64ee2e584c8b4e2eafb3eb8384874079 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:02.012980 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:02.012980 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:02.039899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548a7-0e93-47ab-8db6-df860ea86d63 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:02.118697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:02.119494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:02.119902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:02.120282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] PATH_INFO: `/v3/projects/e3cbb09497964068b158ff361556251a` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:02.121498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cbb09497964068b158ff361556251a)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:02.123718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:02.146111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:02.241933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cbb09497964068b158ff361556251a', 'request_id': 'req-1493e23a-ec5d-421c-bb0f-e86d848c2906'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:02.297792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cbb09497964068b158ff361556251a', 'request_id': 'req-1493e23a-ec5d-421c-bb0f-e86d848c2906'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:02.315890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cbb09497964068b158ff361556251a', 'request_id': 'req-1493e23a-ec5d-421c-bb0f-e86d848c2906'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:02.329587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] The token cache is being invalidate because project e3cbb09497964068b158ff361556251a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:02.329895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:02.330641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:02.332422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1212/2450] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:02 2022] DELETE /identity/v3/projects/e3cbb09497964068b158ff361556251a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:04.865706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:04.867140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:04.920706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:04.924630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ff88d-8424-4de4-b1d2-403b96449699 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:04.980119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:04.981024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:04.981307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:04.981580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:04.983993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:05.051389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:05.052844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:05.063877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1239/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:08.989514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:08.992781 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:09.010349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e23a-ec5d-421c-bb0f-e86d848c2906 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:09.015104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:09.015751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:09.016071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:09.016349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] PATH_INFO: `/v3/users/90304d533deb4ab99b62147d898314eb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:09.017498 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=90304d533deb4ab99b62147d898314eb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:09.020238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:09.261151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90304d533deb4ab99b62147d898314eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.273667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90304d533deb4ab99b62147d898314eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.280645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90304d533deb4ab99b62147d898314eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.281369 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90304d533deb4ab99b62147d898314eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.372298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90304d533deb4ab99b62147d898314eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.386005 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1213/2452] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:08 2022] DELETE /identity/v3/users/90304d533deb4ab99b62147d898314eb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:09.422112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:09.423732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:09.438360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b075-8479-4b2c-8767-01623c191458 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:09.500010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149f559-1162-449d-a35f-009296342725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:09.500685 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f559-1162-449d-a35f-009296342725 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:09.500965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f559-1162-449d-a35f-009296342725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:09.501241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f559-1162-449d-a35f-009296342725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:09.503089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5149f559-1162-449d-a35f-009296342725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:09.572719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f559-1162-449d-a35f-009296342725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:09.574149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f559-1162-449d-a35f-009296342725 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:09.585590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1240/2453] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:09.723257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:09.724766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:09.751228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff3960-2134-44fd-91cb-51bf344a16bf admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:09.758240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:09.762349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:09.762641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:09.762997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] PATH_INFO: `/v3/projects/af5df9ae2f0643e6b1660649814f1135` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:09.764157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5df9ae2f0643e6b1660649814f1135)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:09.766512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:09.904303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5df9ae2f0643e6b1660649814f1135', 'request_id': 'req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.960831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5df9ae2f0643e6b1660649814f1135', 'request_id': 'req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.967507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5df9ae2f0643e6b1660649814f1135', 'request_id': 'req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.979179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] The token cache is being invalidate because project af5df9ae2f0643e6b1660649814f1135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:09.979473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.980191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6f0294e0-cb7f-49bf-ab0f-fb69b18939e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:09.981692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1214/2454] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:09 2022] DELETE /identity/v3/projects/af5df9ae2f0643e6b1660649814f1135 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:09.986730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:09.987067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:09.987884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:09.996773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:10.008661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:10.011346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:10.072692 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1241/2455] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:10.080386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.080908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.080908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.088724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=73,keystone:DELETE=24,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:10.101433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:10.103007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:10.111882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1215/2456] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:10.116986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.126707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115eff-1a22-4303-b91b-9eca679dcf34 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.132137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.132768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.133170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.133518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.134209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:10.134538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.136300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.152066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1242/2457] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:10.153296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.163601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bbd13-2e68-4eb5-b9e4-ee216006071f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.168265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.168933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.169214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.169715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.170358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.172392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.275765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1216/2458] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:10 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:10.282423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.293490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4f03-bc85-48d6-b175-15ec8db9af86 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.368815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.369341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.369626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.369902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.370534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.372500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.453167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1243/2459] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:10 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:10.457694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.467894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2656f86-c9ca-44eb-871c-888b7c9736e1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.473403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.473990 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.474270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.474548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.475184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.476814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.490688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1217/2460] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:10.491917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.502061 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa696f4-c39b-4e65-b6b4-4807c70c9aaf admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.507274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.507875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.508180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.508449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.509082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.512185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c28a-3379-4b57-8289-ba7f410fef9f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.526989 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1244/2461] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:10.528213 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.540504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cde3a-fc84-4a3a-8223-c0e1745f8fb3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.545144 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.545831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.546107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.546404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] PATH_INFO: `/v3/projects/2f4510894c0c4a6cb569fb5034dff6c2/users/1af0ec3908db476689ef1da5f8a78bcc/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.564512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4510894c0c4a6cb569fb5034dff6c2, user_id=1af0ec3908db476689ef1da5f8a78bcc, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.567686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.658967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1218/2462] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:10 2022] PUT /identity/v3/projects/2f4510894c0c4a6cb569fb5034dff6c2/users/1af0ec3908db476689ef1da5f8a78bcc/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:10.665041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.665436 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.665775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.698607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] MFA Rules not processed for user `1af0ec3908db476689ef1da5f8a78bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:10.699999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:10.768461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:10.772757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1245/2463] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:10.783563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:10.785599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:10.861515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f164-1c7a-47c1-9d2f-0f9c6b09d448 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:10.867723 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:10.868356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:10.868634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:10.868909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:10.876878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:10.878993 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:10.888378 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1219/2464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:13.059142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:13.060871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:13.134131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb8049-9bdc-4b80-a4c9-8e9aee9413b9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:13.139221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:13.139824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:13.140150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:13.140445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:13.142248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:13.157198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:13.157198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:13.167313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1246/2465] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:13.220735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:13.222400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:13.300796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bad-f49e-492f-80f2-6fb778224686 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:13.313981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:13.313981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:13.313981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:13.313981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] PATH_INFO: `/v3/users/7024eea9fd7a4859b305e9f7258b9e46` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:13.314383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7024eea9fd7a4859b305e9f7258b9e46)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:13.315126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:13.425473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:13.501298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7024eea9fd7a4859b305e9f7258b9e46'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:13.513175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7024eea9fd7a4859b305e9f7258b9e46'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:13.520386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7024eea9fd7a4859b305e9f7258b9e46'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:13.521174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7024eea9fd7a4859b305e9f7258b9e46'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:13.606455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-057224cb-5221-4bb1-9903-0f26d4c7043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7024eea9fd7a4859b305e9f7258b9e46'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:13.613385 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1220/2466] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:13 2022] DELETE /identity/v3/users/7024eea9fd7a4859b305e9f7258b9e46 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:13.826124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:13.840780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f9325-4135-4ac4-8188-5788a16dbee2 service placement] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:13.900027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:13.900657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:13.900939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:13.901208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] PATH_INFO: `/v3/projects/365f12f5f53f4618aedc9c9a6b373ebe` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:13.902295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365f12f5f53f4618aedc9c9a6b373ebe)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:13.904865 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.023277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365f12f5f53f4618aedc9c9a6b373ebe', 'request_id': 'req-1c774201-2f66-47b2-a6e6-ba60f7e1f309'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:14.029505 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365f12f5f53f4618aedc9c9a6b373ebe', 'request_id': 'req-1c774201-2f66-47b2-a6e6-ba60f7e1f309'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:14.034994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365f12f5f53f4618aedc9c9a6b373ebe', 'request_id': 'req-1c774201-2f66-47b2-a6e6-ba60f7e1f309'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:14.119393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] The token cache is being invalidate because project 365f12f5f53f4618aedc9c9a6b373ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:14.120019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:14.120420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1c774201-2f66-47b2-a6e6-ba60f7e1f309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:14.121943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1247/2467] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:13 2022] DELETE /identity/v3/projects/365f12f5f53f4618aedc9c9a6b373ebe => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:14.126828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.127112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.127406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.147967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:14.149178 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:14.207903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1221/2468] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:14.215726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.216028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.216306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.236063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:14.237294 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:14.245253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1248/2469] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:14.249429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.261477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a56126-7ef9-4a57-b11b-4d2b6d5e5d8d None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.270938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.271478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.271763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.272061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.273160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:14.273661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.276403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.293972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1222/2470] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:14.298409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.308611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019aedd-7c26-468c-bfba-c1a7d535de30 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.313277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.313869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.314148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.314420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.315051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.318114 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.330398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:14.424815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1249/2471] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:14.426359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.461191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698ff26-2b80-45b9-abba-b00f6735229f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.536956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.537992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.538471 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.538856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.539884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.542390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.660801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1223/2472] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:14.664501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.675477 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1c0b-d2e2-42bd-b45b-8d9086faf0fb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.680571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.681172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.681455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.681726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.682429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.683948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.695717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1250/2473] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:14.702878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.713883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475e68-ffc1-4e35-a15c-beca7bba25ee admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.719301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.719956 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.720433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.720705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.721352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.723192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a4b1-e415-412d-b5a8-9bc1f6dcb2fa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.734397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1224/2474] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:14.738808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:14.748905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008a2d-e31a-4990-83d4-941a259babc8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:14.754321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:14.755039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.755323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.755596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] PATH_INFO: `/v3/projects/0db9b92010aa451fa2c824a2f1b839ea/users/f3dfbd64a8c04144949e6847008c5f99/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.770726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db9b92010aa451fa2c824a2f1b839ea, user_id=f3dfbd64a8c04144949e6847008c5f99, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:14.773521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:14.853128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1251/2475] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:14 2022] PUT /identity/v3/projects/0db9b92010aa451fa2c824a2f1b839ea/users/f3dfbd64a8c04144949e6847008c5f99/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:14.865023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:14.865308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:14.865581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:14.886802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:14.899897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] MFA Rules not processed for user `f3dfbd64a8c04144949e6847008c5f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:14.901136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:14.965644 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1225/2476] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:14.970203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.032591 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02842-d1be-44d0-a006-447a4d85c046 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.037366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.037967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.038249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.038521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.039186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.041159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.127622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1252/2477] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:14 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:15.132414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.143030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e54d-98a9-451f-8442-f7e692dbc1ca None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.200844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.201454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.201758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.202033 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.202661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.204615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.315401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1226/2478] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:15 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:15.319330 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.329881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a43f-843b-46a9-b1b4-0f80364c7aa8 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.335284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.335894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.336224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.336501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.337146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.338767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.350262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1253/2479] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:15.354410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.364331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9942d57-e2c9-42e7-b7b3-5a8708f4c102 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.368864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.369501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.369777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.370047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] PATH_INFO: `/v3/projects/08a6a024a6d5475caa15d01f89f826c1/users/083a0214c64f47adad01bce111a05f74/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.384358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a6a024a6d5475caa15d01f89f826c1, user_id=083a0214c64f47adad01bce111a05f74, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.386997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.451636 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1227/2480] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:15 2022] PUT /identity/v3/projects/08a6a024a6d5475caa15d01f89f826c1/users/083a0214c64f47adad01bce111a05f74/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:15.455633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.466410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466142-7b2e-4e33-8dc9-70b98c288d1c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.521824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.522428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.522717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.522990 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.523622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.525317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fad8f9-71c4-4885-a406-79acb5f05a75 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.534815 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1254/2481] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:15.538969 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.549105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f05e-1836-4ca9-b001-f3d3fb1b0d18 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.560744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.561401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.561675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.561943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] PATH_INFO: `/v3/projects/08a6a024a6d5475caa15d01f89f826c1/users/083a0214c64f47adad01bce111a05f74/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.563850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a6a024a6d5475caa15d01f89f826c1, user_id=083a0214c64f47adad01bce111a05f74, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.567019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.577226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1228/2482] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:15 2022] PUT /identity/v3/projects/08a6a024a6d5475caa15d01f89f826c1/users/083a0214c64f47adad01bce111a05f74/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:15.588164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.588457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.588739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.629078 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] MFA Rules not processed for user `083a0214c64f47adad01bce111a05f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:15.630720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:15.649162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:15.711796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1255/2483] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:15.723513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:15.725429 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:15.785769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5f41-6f63-476b-a4ec-bba36f8cf9f1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:15.789580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:15.793494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:15.793494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:15.793494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:15.796853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:15.801227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:15.802655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5b02c-04cf-4db2-8766-addd9d1f7eaf service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:15.812108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1229/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:16.652423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:16.716185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e52d-fa9e-45ba-9bff-657f460e3dd8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:16.720763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:16.721382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:16.722353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:16.722682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] PATH_INFO: `/v3/users/f3dfbd64a8c04144949e6847008c5f99` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:16.723792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3dfbd64a8c04144949e6847008c5f99)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:16.725777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:16.935391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dfbd64a8c04144949e6847008c5f99'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:16.948190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dfbd64a8c04144949e6847008c5f99'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:16.955029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dfbd64a8c04144949e6847008c5f99'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.040833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dfbd64a8c04144949e6847008c5f99'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.046744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dfbd64a8c04144949e6847008c5f99'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.048028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1256/2485] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:16 2022] DELETE /identity/v3/users/f3dfbd64a8c04144949e6847008c5f99 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:17.052540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.052981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.053147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.074321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:17.075522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.082960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:17.083933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.118603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:17.139763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1230/2486] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:17.149619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57244b51-cefa-4b06-a016-3f4e6d187064 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:17.150129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:17.151464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.154375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:17.155008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.155285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.155554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] PATH_INFO: `/v3/users/1af0ec3908db476689ef1da5f8a78bcc` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.156710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af0ec3908db476689ef1da5f8a78bcc)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:17.158617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:17.208829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b73fe-f956-4cc8-8519-2d93b371a387 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:17.212410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:17.218831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.218831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.218831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.222436 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:17.223850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37984109-e28a-4250-af65-898deb4db8b0 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:17.233220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1231/2487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:17.311429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af0ec3908db476689ef1da5f8a78bcc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.324474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af0ec3908db476689ef1da5f8a78bcc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.332654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af0ec3908db476689ef1da5f8a78bcc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.406740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af0ec3908db476689ef1da5f8a78bcc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.407362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af0ec3908db476689ef1da5f8a78bcc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.413881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1257/2488] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:17 2022] DELETE /identity/v3/users/1af0ec3908db476689ef1da5f8a78bcc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:17.418350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.418632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.418906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.438851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:17.440108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.504605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1232/2489] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:17.514501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:17.516142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.578322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c410-9ad7-4615-af25-a0863d666674 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:17.582623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:17.583260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.583543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.587965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.593592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:17.595007 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:17.605174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1258/2490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:17.677247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:17.679071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:17.694832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605568c3-a757-40ea-8f4f-79f076bdef1a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:17.700042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:17.700838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:17.701257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:17.701667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] PATH_INFO: `/v3/projects/0db9b92010aa451fa2c824a2f1b839ea` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:17.703191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db9b92010aa451fa2c824a2f1b839ea)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:17.709706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:17.865099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:17.877652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db9b92010aa451fa2c824a2f1b839ea', 'request_id': 'req-1a836257-4926-4a53-95bb-b31b83265d1a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.978027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db9b92010aa451fa2c824a2f1b839ea', 'request_id': 'req-1a836257-4926-4a53-95bb-b31b83265d1a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.985395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db9b92010aa451fa2c824a2f1b839ea', 'request_id': 'req-1a836257-4926-4a53-95bb-b31b83265d1a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.997114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] The token cache is being invalidate because project 0db9b92010aa451fa2c824a2f1b839ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:17.997405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.998064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:17.999579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1233/2491] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:17 2022] DELETE /identity/v3/projects/0db9b92010aa451fa2c824a2f1b839ea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:18.004982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:18.015135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83672f-7cfb-482a-89df-8286c18a2fde service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:18.066577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:18.075872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:18.076542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.076821 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.077094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] PATH_INFO: `/v3/users/083a0214c64f47adad01bce111a05f74` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.078240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083a0214c64f47adad01bce111a05f74)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:18.080262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:18.104830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:18.106732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:18.121000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836257-4926-4a53-95bb-b31b83265d1a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:18.126180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:18.132069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.132069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.132069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] PATH_INFO: `/v3/projects/2f4510894c0c4a6cb569fb5034dff6c2` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.132069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4510894c0c4a6cb569fb5034dff6c2)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:18.132069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:18.254620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083a0214c64f47adad01bce111a05f74'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.255000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4510894c0c4a6cb569fb5034dff6c2', 'request_id': 'req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.269422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083a0214c64f47adad01bce111a05f74'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.276992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083a0214c64f47adad01bce111a05f74'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.320940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4510894c0c4a6cb569fb5034dff6c2', 'request_id': 'req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.327615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4510894c0c4a6cb569fb5034dff6c2', 'request_id': 'req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.338324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] The token cache is being invalidate because project 2f4510894c0c4a6cb569fb5034dff6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:18.338608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.339270 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-69d04a6d-53bc-4d2f-ae3b-afaf2e56bc7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.340816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1234/2492] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:18 2022] DELETE /identity/v3/projects/2f4510894c0c4a6cb569fb5034dff6c2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:18.345551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.345832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.346108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.365503 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:18.366684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:18.389071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083a0214c64f47adad01bce111a05f74'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.389698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-db0c40db-2569-4e71-b2eb-02faeb4edf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083a0214c64f47adad01bce111a05f74'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:18.396288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1259/2493] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:18 2022] DELETE /identity/v3/users/083a0214c64f47adad01bce111a05f74 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:18.427418 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1235/2494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:18.437083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.437385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.437960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.460384 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:18.461611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:18.524399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1260/2495] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:18.528801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:18.538917 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ace2d-d8ed-4386-905b-aa3495f9e11a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:18.543712 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:18.544350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.547239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.547239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.547239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:18.547239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:18.547580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:18.559855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1236/2496] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:18.564079 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:18.573305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883d8d7-2713-4969-8b94-cd293740e5a1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:18.578030 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:18.578630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.578912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.579188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.579831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:18.581754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:18.671214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1261/2497] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:18 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:18.676659 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:18.687238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea67bd1-c1a5-404f-b0ff-085a8bf342ad admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:18.716084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:18.743894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:18.744535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:18.744827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:18.745075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:18.745711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:18.747628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.070788 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1237/2498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:18 2022] POST /identity/v3/users => generated 284 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:19.072285 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.074251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:19.074911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.087184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998fd37-d5b1-4f0e-8b1d-72354d53a622 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.091941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.092588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.092868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.093133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.093803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.094648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf9caa-a3d4-4cf1-bdb7-ae15970932dc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.095495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.101594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.102312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.102544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.102877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] PATH_INFO: `/v3/projects/08a6a024a6d5475caa15d01f89f826c1` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.104020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a6a024a6d5475caa15d01f89f826c1)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.106130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.114305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1238/2499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:19.115797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.125509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6b8e7-544f-40f9-8657-c1bd1c8ac035 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.130192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.130910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.131131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.131384 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.132054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.133634 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.144387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1239/2500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:19.148407 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.158108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed8cc-28ae-413c-876a-4e980c7c54e9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.163658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.164456 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.164864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.165147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] PATH_INFO: `/v3/projects/0b3f55ba50cf4d43aa3b58e3747d806c/users/865268649e234ace9e8016dfedd0e5c7/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.183537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3f55ba50cf4d43aa3b58e3747d806c, user_id=865268649e234ace9e8016dfedd0e5c7, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.186382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489dd5f-5b1f-4662-b499-a56535165f47 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.192242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:19.195116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a6a024a6d5475caa15d01f89f826c1', 'request_id': 'req-50102880-46f5-4f47-8ce8-5220458e24ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:19.201792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a6a024a6d5475caa15d01f89f826c1', 'request_id': 'req-50102880-46f5-4f47-8ce8-5220458e24ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:19.208496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a6a024a6d5475caa15d01f89f826c1', 'request_id': 'req-50102880-46f5-4f47-8ce8-5220458e24ab'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:19.292811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1240/2501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:19 2022] PUT /identity/v3/projects/0b3f55ba50cf4d43aa3b58e3747d806c/users/865268649e234ace9e8016dfedd0e5c7/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:19.303327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.303616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.303892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.327223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] The token cache is being invalidate because project 08a6a024a6d5475caa15d01f89f826c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:19.327506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:19.328160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-50102880-46f5-4f47-8ce8-5220458e24ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:19.329639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1262/2502] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:19 2022] DELETE /identity/v3/projects/08a6a024a6d5475caa15d01f89f826c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:19.334820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e927a-7e44-4f0a-90c1-68176abb0c2e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.335107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e927a-7e44-4f0a-90c1-68176abb0c2e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.335386 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e927a-7e44-4f0a-90c1-68176abb0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.348244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] MFA Rules not processed for user `865268649e234ace9e8016dfedd0e5c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:19.349445 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:19.356132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-491e927a-7e44-4f0a-90c1-68176abb0c2e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:19.357359 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-491e927a-7e44-4f0a-90c1-68176abb0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:19.416938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1241/2503] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:19.424051 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1263/2504] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:19.428733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.428733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:19.428954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.428954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.428954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.437183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a85b-64b3-4be0-b5e0-cb178a9d13a6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.442742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.443367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.443646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.443919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.444627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.446537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.447401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:19.448629 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:19.457010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1264/2505] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:19.461242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.470333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3e585-177b-4749-85b6-2e240832b045 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.476559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.479589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.479589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.479589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.479589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:19.479589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.480449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.492937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1265/2506] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:16:19.497336 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.507067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98963c14-6d8d-4759-ad7c-3563784390dc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.511632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.512236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.513127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.513406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.514016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.515838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.543172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1242/2507] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:19.544368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.590247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:19.607750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1058-ed4a-4b05-9cc6-f69f6bfca4ab admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.612605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.613304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.613591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.613894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.614527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.616475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.623218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1266/2508] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:19.627328 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.686796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9b906-41d8-45f3-ace5-3be414cd28af admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.692225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.692844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.693128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.693405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.694032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.696017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.713847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1243/2509] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:19.715477 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.726348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7f94-a6f1-4592-b55b-ab10fb3ed8c9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.730908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.731509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.731805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.732112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.732755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.734348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.750291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1244/2510] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:19.754273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.764414 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2866b-e925-48d7-a13b-c629ef623020 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.769247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.769884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.770164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.770434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] PATH_INFO: `/v3/projects/bacfd515b82b4e3191c58331acb10523/users/a7426799583f4c9fb76879144f92645d/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.787094 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacfd515b82b4e3191c58331acb10523, user_id=a7426799583f4c9fb76879144f92645d, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.789787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.801510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1267/2511] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:19 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:19.807652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.816221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583112-0e7c-492b-9400-85bbe090eed4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.821053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.821657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.822093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.822264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.822934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.824575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.836116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1268/2512] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:19.840725 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.850871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dcc42-40ef-4749-b5ca-aa12dd04e532 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.856423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.857025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.857309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.857583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.858221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.859814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.860110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1245/2513] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:19 2022] PUT /identity/v3/projects/bacfd515b82b4e3191c58331acb10523/users/a7426799583f4c9fb76879144f92645d/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:19.873111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:19.873111 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1269/2514] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:19.877003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.877168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.887320 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42fe5-9ce6-408f-9a78-3e193a8bda3d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.947947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3102-2f9c-480c-abbc-c674ca24b793 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.953780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.954390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.954707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.955253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.955564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.957023 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.960523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.960656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.960774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.960774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] PATH_INFO: `/v3/projects/43d3df8ee899438a9ede3f5b54f2d8ef/users/d3ea81199cc843689c4badd5cf0035af/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.968758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1246/2515] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:19.973253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:19.979348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d3df8ee899438a9ede3f5b54f2d8ef, user_id=d3ea81199cc843689c4badd5cf0035af, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.982024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916d18a-b02a-4ade-974c-b15c6ab7274c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:19.983287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddebea-603c-4c98-9552-aa7ec5f9bbb8 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:19.988080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:19.988837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:19.989182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:19.989524 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] PATH_INFO: `/v3/projects/bacfd515b82b4e3191c58331acb10523/users/a7426799583f4c9fb76879144f92645d/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:19.991547 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacfd515b82b4e3191c58331acb10523, user_id=a7426799583f4c9fb76879144f92645d, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:19.994175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f234-357f-4dda-abc1-895ee2b992ba admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.005988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1247/2516] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:19 2022] PUT /identity/v3/projects/bacfd515b82b4e3191c58331acb10523/users/a7426799583f4c9fb76879144f92645d/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:20.016308 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.016591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.016864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.046919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] MFA Rules not processed for user `a7426799583f4c9fb76879144f92645d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:20.048777 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:20.056063 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1270/2517] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:19 2022] PUT /identity/v3/projects/43d3df8ee899438a9ede3f5b54f2d8ef/users/d3ea81199cc843689c4badd5cf0035af/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:20.068196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.068568 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.068754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.104561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] MFA Rules not processed for user `d3ea81199cc843689c4badd5cf0035af`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:20.105794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:20.139390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1248/2518] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:20.151377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.153419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:20.161168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:20.185319 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1271/2519] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:20.190583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.228760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06d50-13e2-44a0-a43c-9a15c7733556 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.232782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.233460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.233744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.234015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.247130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.249594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.260140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90720e38-7ccd-44c3-a900-d5eeade8a40d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.263306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1249/2520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:20.269083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.269743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.269976 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.270250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.270891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.276129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.390824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:20.411851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1272/2521] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:20 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:20.415920 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.430056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bdeb1-d854-4d51-bfdb-da19ec8fcf92 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.496359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.497040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.497325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.497681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.508330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.516693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.601559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1250/2522] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:20 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:20.605669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.616862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22957-a98e-421c-a3ee-11dc9b77c042 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.621478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.622088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.622496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.622647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.623283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.631972 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.636329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1273/2523] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:20.640423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.650984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db9d2a-a1e0-4484-9e86-0387c509dd11 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.655629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.656318 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.656600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.656944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] PATH_INFO: `/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3/users/db48ba21dd5247e0a9eda9f6bcccefab/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.673009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235525b5a16f4f2dbd80fb70d74cc8f3, user_id=db48ba21dd5247e0a9eda9f6bcccefab, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.676683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.744405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1251/2524] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:20 2022] PUT /identity/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3/users/db48ba21dd5247e0a9eda9f6bcccefab/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:20.750470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.760749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4eed3-e757-4055-bb27-99504f645247 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.817792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.818397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.818675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.818950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.819582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.821237 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d830-dc1c-49b5-8d6c-2657d4a2cc7e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.834411 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1274/2525] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:20.835493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.846218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93866-b245-47ed-a874-6b465bdd7842 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:20.851635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:20.852317 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.852593 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.852866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] PATH_INFO: `/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3/users/db48ba21dd5247e0a9eda9f6bcccefab/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.854764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=235525b5a16f4f2dbd80fb70d74cc8f3, user_id=db48ba21dd5247e0a9eda9f6bcccefab, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:20.857482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:20.868639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1252/2526] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:20 2022] PUT /identity/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3/users/db48ba21dd5247e0a9eda9f6bcccefab/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:20.878753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576007b-e469-42fe-89b1-83df61580256 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:20.879607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576007b-e469-42fe-89b1-83df61580256 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:20.879607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576007b-e469-42fe-89b1-83df61580256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:20.906426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a576007b-e469-42fe-89b1-83df61580256 None None] MFA Rules not processed for user `db48ba21dd5247e0a9eda9f6bcccefab`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:20.908273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a576007b-e469-42fe-89b1-83df61580256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:20.976047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1275/2527] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:20.987415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:20.990185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:21.049946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c3f1f-83c9-4aaa-a7e2-8cea06a1fb2a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:21.055084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:21.055691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:21.056046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:21.056310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:21.067707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:21.068085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd336-b444-4039-9f8e-393d298f5178 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:21.077802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1253/2528] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:22.322419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576007b-e469-42fe-89b1-83df61580256 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:22.398504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576007b-e469-42fe-89b1-83df61580256 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:22.403376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:22.404029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:22.404449 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:22.404727 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] PATH_INFO: `/v3/users/d3ea81199cc843689c4badd5cf0035af` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:22.405968 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ea81199cc843689c4badd5cf0035af)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:22.407866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:22.421159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:22.616789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ea81199cc843689c4badd5cf0035af'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:22.630145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ea81199cc843689c4badd5cf0035af'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:22.641022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ea81199cc843689c4badd5cf0035af'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:22.710263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ea81199cc843689c4badd5cf0035af'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:22.710975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ea81199cc843689c4badd5cf0035af'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:22.719718 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1276/2529] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:22 2022] DELETE /identity/v3/users/d3ea81199cc843689c4badd5cf0035af => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:22.722847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:22.723349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:22.723444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:22.732757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:22.764423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:22.768367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:22.838775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1254/2530] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:22.849605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:22.851554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:22.919570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef4df-98d7-418b-82a2-dc881bb39002 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:22.925321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:22.925321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:22.925321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:22.925564 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:22.936596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:22.938228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:22.953901 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1277/2531] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:23.369319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:23.370835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.385386 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e23a9-b603-45f3-8829-70ce7995ecb8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:23.390097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:23.390732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:23.391009 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:23.391332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] PATH_INFO: `/v3/projects/43d3df8ee899438a9ede3f5b54f2d8ef` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:23.393014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d3df8ee899438a9ede3f5b54f2d8ef)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:23.395224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:23.448469 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:23.449930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.463020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3624-2548-40fb-930f-ec115226b433 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:23.467471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:23.468124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:23.468412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:23.468672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] PATH_INFO: `/v3/users/865268649e234ace9e8016dfedd0e5c7` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:23.469794 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=865268649e234ace9e8016dfedd0e5c7)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:23.471677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:23.514251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d3df8ee899438a9ede3f5b54f2d8ef', 'request_id': 'req-3f70db99-58f8-4d25-8fb1-253f74c08b7c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.577978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d3df8ee899438a9ede3f5b54f2d8ef', 'request_id': 'req-3f70db99-58f8-4d25-8fb1-253f74c08b7c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.584694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d3df8ee899438a9ede3f5b54f2d8ef', 'request_id': 'req-3f70db99-58f8-4d25-8fb1-253f74c08b7c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.597939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] The token cache is being invalidate because project 43d3df8ee899438a9ede3f5b54f2d8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:23.598235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.598892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.601013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1255/2532] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:23 2022] DELETE /identity/v3/projects/43d3df8ee899438a9ede3f5b54f2d8ef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:23.604964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:23.606282 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.671654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70db99-58f8-4d25-8fb1-253f74c08b7c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:23.676508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:23.677134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:23.677417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:23.677697 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] PATH_INFO: `/v3/users/db48ba21dd5247e0a9eda9f6bcccefab` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:23.679432 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=db48ba21dd5247e0a9eda9f6bcccefab)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:23.681769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:23.699251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865268649e234ace9e8016dfedd0e5c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.711510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865268649e234ace9e8016dfedd0e5c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.718307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865268649e234ace9e8016dfedd0e5c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.773219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:23.800606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865268649e234ace9e8016dfedd0e5c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.801228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-845877fc-62fd-44b0-83ae-f85222d27feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865268649e234ace9e8016dfedd0e5c7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.808746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1278/2533] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:23 2022] DELETE /identity/v3/users/865268649e234ace9e8016dfedd0e5c7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:23.813001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:23.813290 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:23.813571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:23.820502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:23.833446 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:23.834723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.893466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1279/2534] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:23.900169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db48ba21dd5247e0a9eda9f6bcccefab'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.904033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:23.905499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.912507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db48ba21dd5247e0a9eda9f6bcccefab'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.920104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db48ba21dd5247e0a9eda9f6bcccefab'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.920815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db48ba21dd5247e0a9eda9f6bcccefab'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.964963 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069217-a48b-4a76-a4cf-6014650b9311 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:23.970247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:23.970932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:23.971215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:23.973604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:23.976057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:23.978294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db48ba21dd5247e0a9eda9f6bcccefab'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:23.985076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1256/2535] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:23 2022] DELETE /identity/v3/users/db48ba21dd5247e0a9eda9f6bcccefab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:23.998006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:23.999491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:24.009604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1280/2536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:24.618925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:24.618925 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:24.644970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:24.646416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:24.660447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c34ec-b9c2-4025-b0e6-ee9915e53161 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:24.731218 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:24.731933 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:24.732243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:24.737627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] PATH_INFO: `/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:24.737771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ff375-0d2c-4a32-aa53-8c7487562bec admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:24.737878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] RBAC: Authorizing `identity:delete_project(project_id=235525b5a16f4f2dbd80fb70d74cc8f3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:24.737878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:24.738535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:24.739179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:24.739458 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:24.739732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] PATH_INFO: `/v3/projects/0b3f55ba50cf4d43aa3b58e3747d806c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:24.741047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3f55ba50cf4d43aa3b58e3747d806c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:24.743577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:24.827991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:24.829552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235525b5a16f4f2dbd80fb70d74cc8f3', 'request_id': 'req-1d7a4f5a-022b-42ce-9515-4a675841750f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.837047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235525b5a16f4f2dbd80fb70d74cc8f3', 'request_id': 'req-1d7a4f5a-022b-42ce-9515-4a675841750f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.842678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235525b5a16f4f2dbd80fb70d74cc8f3', 'request_id': 'req-1d7a4f5a-022b-42ce-9515-4a675841750f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.847722 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3f55ba50cf4d43aa3b58e3747d806c', 'request_id': 'req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.922635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] The token cache is being invalidate because project 235525b5a16f4f2dbd80fb70d74cc8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:24.922882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.923518 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1d7a4f5a-022b-42ce-9515-4a675841750f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.925052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1281/2537] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:24 2022] DELETE /identity/v3/projects/235525b5a16f4f2dbd80fb70d74cc8f3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:24.929158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0017f3-867c-42e9-8e5d-c19d435c4670 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:24.929810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0017f3-867c-42e9-8e5d-c19d435c4670 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:24.930611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0017f3-867c-42e9-8e5d-c19d435c4670 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:24.932225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1282/2538] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:16:24.933264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:24.933545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:24.933819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:24.956578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:24.957862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:24.961038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3f55ba50cf4d43aa3b58e3747d806c', 'request_id': 'req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.967857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3f55ba50cf4d43aa3b58e3747d806c', 'request_id': 'req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.979121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] The token cache is being invalidate because project 0b3f55ba50cf4d43aa3b58e3747d806c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:24.979411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.980109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c5f30729-1aac-4d78-af2a-4dcb5b4ce447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:24.981649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1257/2539] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:24 2022] DELETE /identity/v3/projects/0b3f55ba50cf4d43aa3b58e3747d806c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:24.983012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be3ff-8821-40be-be12-773d24299f28 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:24.983296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be3ff-8821-40be-be12-773d24299f28 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:24.983570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be3ff-8821-40be-be12-773d24299f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.003091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ed8be3ff-8821-40be-be12-773d24299f28 None None] MFA Rules not processed for user `79a68e7eaa644d2aa9616ba1dde8fd95`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:25.004319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ed8be3ff-8821-40be-be12-773d24299f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.028293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1283/2540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:25.029335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.031434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.035763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:25.043050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb3e64-ee89-4d99-96de-8576b42773ba None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.048277 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.048907 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.049362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.049640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] PATH_INFO: `/v3/users/a7426799583f4c9fb76879144f92645d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.051132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7426799583f4c9fb76879144f92645d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.053201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.057218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1258/2541] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:25.058796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.059152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.059482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.080922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:25.082113 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.090581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1259/2542] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:25.091343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.092546 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.104236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc1e3-5688-4678-b622-b8713d6ba40a None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.108419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.109002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.109274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.109538 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.116400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.117934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.125511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1260/2543] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:25.126262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.137021 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d78e8-0202-439e-9799-9f99b9c5e330 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.141624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.142217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.142494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.142769 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.143397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:25.143845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.145452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.158619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1261/2544] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:25.162946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.172935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fc32-1888-468b-839c-d514175ebb44 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.178000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.178841 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.180139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.180544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.181181 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.183169 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b58e0-2f07-42b5-8924-2a092d62bad5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.213740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7426799583f4c9fb76879144f92645d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:25.226789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7426799583f4c9fb76879144f92645d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:25.233693 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7426799583f4c9fb76879144f92645d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:25.282568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1262/2545] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:25 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:25.283885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d7f5-94a1-4e70-9c68-80761da01c68 None None] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.284207 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d7f5-94a1-4e70-9c68-80761da01c68 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.284485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d7f5-94a1-4e70-9c68-80761da01c68 None None] PATH_INFO: `/` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.285945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1263/2546] 10.222.0.43 () {54 vars in 921 bytes} [Tue Sep 13 08:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 08:16:25.286790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01d7f5-94a1-4e70-9c68-80761da01c68 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.297916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7426799583f4c9fb76879144f92645d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:25.298627 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-72b38b59-2f11-4bbe-ac3b-3e9835597999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7426799583f4c9fb76879144f92645d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:25.305545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1284/2547] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:25 2022] DELETE /identity/v3/users/a7426799583f4c9fb76879144f92645d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:25.306670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.306946 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.307215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.328428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] MFA Rules not processed for user `5f3b6c53dcc844c784c17f6c4af76bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:25.329690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.368239 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01d7f5-94a1-4e70-9c68-80761da01c68 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.384561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:25.418874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1285/2548] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Sep 13 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:25.431292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.431292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.431292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.431292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.431715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.431805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.431897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.432406 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.486906 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0cd6c-33ad-4ab8-ba77-55f15fe18fe6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.490472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.491779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.492091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.492367 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.504861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.506422 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.512896 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1264/2549] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:25 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:25.514193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.516187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.518875 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1286/2550] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:25.529554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c806-ed7f-4acf-a4d2-872b0a29459c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.534331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.534933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.535274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.535576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.536261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.538582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.548827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1265/2551] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:25.553322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.571025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d9d5-dabb-42aa-bdec-a4db00b7aee7 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.576573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.577448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.583115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.583115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.583115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.583115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6eb9b-0452-4d1b-80e6-b6552ef95711 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.591920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1287/2552] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:25.596324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.607740 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f992e-0da6-49d3-a8ac-57f24a126f42 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.616403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.617415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.617819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.618105 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] PATH_INFO: `/v3/projects/31701e49183d43b1a9d44aa590c69110/users/8d7bb7c2df1846f3a5fa04142e34f6da/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.633306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:25.637284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31701e49183d43b1a9d44aa590c69110, user_id=8d7bb7c2df1846f3a5fa04142e34f6da, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.640464 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.727333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1266/2553] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:25 2022] PUT /identity/v3/projects/31701e49183d43b1a9d44aa590c69110/users/8d7bb7c2df1846f3a5fa04142e34f6da/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:25.732430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.732910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.733049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.753409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:25.754613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.811995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.814910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:25.822830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1288/2554] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:25.844159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:25.845598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8adc-7f7a-4817-abb8-d2a7eabe693e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.855415 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.857315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.857603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.857908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] PATH_INFO: `/v3/projects/bacfd515b82b4e3191c58331acb10523` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.859206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacfd515b82b4e3191c58331acb10523)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.861133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.917590 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b503-3287-4771-b77e-83ad20e74aa3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:25.921531 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:25.922256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:25.922541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:25.922814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:25.933134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:25.934556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d8a9c-8029-488b-ba42-490d30b45195 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:25.945923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1289/2555] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:26.002372 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacfd515b82b4e3191c58331acb10523', 'request_id': 'req-d17b52ab-54e0-4234-8a2c-8cb11256262a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:26.075038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacfd515b82b4e3191c58331acb10523', 'request_id': 'req-d17b52ab-54e0-4234-8a2c-8cb11256262a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:26.082054 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacfd515b82b4e3191c58331acb10523', 'request_id': 'req-d17b52ab-54e0-4234-8a2c-8cb11256262a'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:26.093620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] The token cache is being invalidate because project bacfd515b82b4e3191c58331acb10523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:26.093919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:26.094622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-d17b52ab-54e0-4234-8a2c-8cb11256262a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:26.096212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1267/2556] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:25 2022] DELETE /identity/v3/projects/bacfd515b82b4e3191c58331acb10523 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:26.102052 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.102345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.102618 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.123748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:26.124995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:26.135224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:26.187087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1290/2557] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:26.195177 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.195537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.195820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.217686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:26.219011 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:26.228220 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1268/2558] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:26.232414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.243774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa2c1-1636-4391-8613-8d2e4e483f7a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.248445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.250208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.250208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.250208 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.250677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:26.250677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.253059 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.269643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1291/2559] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:26.271522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.282632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e057dc-fe8c-43da-a9d3-5163dcf08cbc None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.287339 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.288733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.289228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.289511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.290153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.292077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.397035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1269/2560] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:26.402035 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.412291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0746f8-5d89-4b8e-9d2d-bf98c9bec3f4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.484647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.485251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.485534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.485806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.486561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.492695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.592013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1292/2561] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:26.596133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.607506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c693-6988-408d-9c63-d8ae6a475b5d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.613083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.613924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.614603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.614887 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.615530 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.617393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.628996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1270/2562] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:26.634092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.645274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089dff-7172-45a9-be4d-4814751c32a2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.650464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.651077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.651348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.651619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.652315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.653973 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32e60d-a715-4e60-a1d6-5d88a0db21b5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.667683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1293/2563] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:26.671941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.682946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4fc0-4568-4de4-bb7b-bec1bc6a13b2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.689672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.690329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.690602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.690875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] PATH_INFO: `/v3/projects/211f4f2d53314f52ac266c6b8089bdeb/users/fb472ea8cce24a0db9bf9349345c1428/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.710465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=211f4f2d53314f52ac266c6b8089bdeb, user_id=fb472ea8cce24a0db9bf9349345c1428, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.710667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.773763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1271/2564] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:26 2022] PUT /identity/v3/projects/211f4f2d53314f52ac266c6b8089bdeb/users/fb472ea8cce24a0db9bf9349345c1428/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:26.784300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.784826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.784925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.814125 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] MFA Rules not processed for user `fb472ea8cce24a0db9bf9349345c1428`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:26.815363 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:26.886305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1294/2565] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:26.890717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:26.958088 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e678-1b6b-4011-bbad-9e0973781e6a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:26.963497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:26.964048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:26.964329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:26.964601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:26.965240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:26.967122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:26.982131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:27.056745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1272/2566] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:26 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:27.060996 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.075389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0427f-a709-4871-9c7b-58f77872d8af None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.084533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:27.142908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.143443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.144326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.144326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.144941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.147322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560207-1b18-4327-add0-972501fc904e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.239083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1295/2567] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:27 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:27.246953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.249584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.250006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.250418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.260492 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd93eaf-e9e7-4b87-8aca-8c38b1c54a0e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.271964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.271964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.271964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.273010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.273010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.274463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.289092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1273/2568] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:27.293632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.307089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200e00-63cd-4b5c-bcaf-6053b41e7127 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.308402 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] MFA Rules not processed for user `8d7bb7c2df1846f3a5fa04142e34f6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:27.309614 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:27.312156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.313779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.314258 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.314566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] PATH_INFO: `/v3/projects/9f1e2282872949b797a2216a7da6b1f4/users/928534c15c7246fb9c2b190751318e35/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.333734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e2282872949b797a2216a7da6b1f4, user_id=928534c15c7246fb9c2b190751318e35, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.338215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.393593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1296/2569] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:27.398810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.400166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:27.416397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d42c9-1a4c-443c-b128-2154f0e95d02 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.421292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.421959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.422385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.422664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.423304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.425455 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.432910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1274/2570] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:27 2022] PUT /identity/v3/projects/9f1e2282872949b797a2216a7da6b1f4/users/928534c15c7246fb9c2b190751318e35/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:27.437744 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.509398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988393c7-7913-4cf1-9ac5-95228c88a31f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.514428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.515374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.515770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.516192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.517534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.519510 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.533085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1275/2571] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:27.537205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.543152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1297/2572] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:27.547313 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.549958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e811b-437f-4b9a-8e92-bc45b226cb8c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.614140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.614849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.615685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.615685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] PATH_INFO: `/v3/projects/9f1e2282872949b797a2216a7da6b1f4/users/928534c15c7246fb9c2b190751318e35/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.618410 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e2282872949b797a2216a7da6b1f4, user_id=928534c15c7246fb9c2b190751318e35, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.621716 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46826448-7f33-4959-ab1a-053ae32c32b5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.638082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1276/2573] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:27 2022] PUT /identity/v3/projects/9f1e2282872949b797a2216a7da6b1f4/users/928534c15c7246fb9c2b190751318e35/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:27.650866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.651156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.651440 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.665762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b0e5a-de6d-422c-943d-df66ea447e78 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.683513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] MFA Rules not processed for user `928534c15c7246fb9c2b190751318e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:27.683951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:27.684766 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:27.729897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:27.741677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.743008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.743305 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.743585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.744264 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.746262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.765020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1277/2574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:27.777237 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.778661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:27.836590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f1c7f-e1bb-4acb-bfc0-7067a2c5bdf9 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.840383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.840991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.841275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.841551 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.851039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.852523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.861861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1278/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:27.909886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1298/2576] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:27 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:27.914112 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.924508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc193942-2c14-4399-aeb2-f90bc69ab087 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.930309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.930906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.931198 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.931470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.932152 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.933742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:27.946016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1279/2577] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:27.950315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:27.961255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f263-0b1d-4453-b147-809dbfdb7746 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:27.966459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:27.967126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:27.967754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:27.968069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] PATH_INFO: `/v3/projects/1e4af79ed74e4d81909a6668f69fe680/users/55801ac185ba4803b33e2c4abb667d4c/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:27.983315 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4af79ed74e4d81909a6668f69fe680, user_id=55801ac185ba4803b33e2c4abb667d4c, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:27.986015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:28.055362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1299/2578] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:27 2022] PUT /identity/v3/projects/1e4af79ed74e4d81909a6668f69fe680/users/55801ac185ba4803b33e2c4abb667d4c/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:28.058591 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:28.071180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdad2dd-0d31-42d4-94e4-9f6280ef8bf9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:28.130735 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:28.131354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:28.132184 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:28.136608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:28.136608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:28.136608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:28.145543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1280/2579] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:28.150041 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:28.160405 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ad1d-bdab-49a6-b371-1daa4982bd84 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:28.165799 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:28.166458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:28.166764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:28.167039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] PATH_INFO: `/v3/projects/1e4af79ed74e4d81909a6668f69fe680/users/55801ac185ba4803b33e2c4abb667d4c/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:28.168970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4af79ed74e4d81909a6668f69fe680, user_id=55801ac185ba4803b33e2c4abb667d4c, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:28.171636 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:28.183050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1300/2580] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:28 2022] PUT /identity/v3/projects/1e4af79ed74e4d81909a6668f69fe680/users/55801ac185ba4803b33e2c4abb667d4c/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:28.984869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:29.051755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c2f6-3636-45d4-a751-92ad4093ccf9 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:29.060348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:29.109350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928534c15c7246fb9c2b190751318e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f1e2282872949b797a2216a7da6b1f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:29.110061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.110447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.110852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.111616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:29.111930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:29.113585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:29.125804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1281/2581] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:29.129918 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:29.140684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341a23-3e6b-4e89-89e5-136fb9bb9356 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:29.145293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928534c15c7246fb9c2b190751318e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f1e2282872949b797a2216a7da6b1f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:29.145892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.146176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.146452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.147153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:29.149131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:29.266020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1301/2582] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:29 2022] POST /identity/v3/projects => generated 354 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:29.269988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:29.281447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51456f-f330-4966-8112-5152477790b2 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:29.342118 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928534c15c7246fb9c2b190751318e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f1e2282872949b797a2216a7da6b1f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:29.342771 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.343057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.343336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.344010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:29.344312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:29.345921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880099e-afdd-4377-b1f7-0a3e00b14955 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:29.362274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1282/2583] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:29.396874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:29.408055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598392-8976-4400-bef0-c1a927220461 tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:29.412747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928534c15c7246fb9c2b190751318e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f1e2282872949b797a2216a7da6b1f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:29.414409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.414719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.415027 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] PATH_INFO: `/v3/projects/5e436614229c4a1c9b0047fc23a69457` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.416203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e436614229c4a1c9b0047fc23a69457)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:29.418088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:29.534849 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e436614229c4a1c9b0047fc23a69457', 'request_id': 'req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:29.542832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e436614229c4a1c9b0047fc23a69457', 'request_id': 'req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:29.548769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e436614229c4a1c9b0047fc23a69457', 'request_id': 'req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:29.578973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.579259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.579534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.618350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] MFA Rules not processed for user `55801ac185ba4803b33e2c4abb667d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:29.619491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:29.623458 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] The token cache is being invalidate because project 5e436614229c4a1c9b0047fc23a69457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:29.623805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:29.624472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-faf51f19-47bb-4b7f-bf1a-d1a586404d9e tempest-VolumeQuotaClassesTest-1581480123 tempest-VolumeQuotaClassesTest-1581480123-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:29.629724 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1302/2584] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:29 2022] DELETE /identity/v3/projects/5e436614229c4a1c9b0047fc23a69457 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:29.722393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1283/2585] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:29.734230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.734577 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.734861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.766856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] MFA Rules not processed for user `8d7bb7c2df1846f3a5fa04142e34f6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:29.768113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:29.793391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:29.824640 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1303/2586] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:29.836676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:29.838065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:29.866469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:29.911868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d193f3e-da4d-4d27-80f5-ac2aec3479f4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:29.917283 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:29.917885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:29.918161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:29.918430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:29.920199 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:29.930465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:29.932061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:29.949668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1284/2587] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:30.185254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:30.194890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:30.286090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5226d8-1666-4460-a4fc-982dca18e28b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:30.289930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:30.290537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:30.290852 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:30.291123 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:30.298300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:30.302644 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:30.307338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d281-a309-4dca-9b17-16625848dc96 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:30.308484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:30.310014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:30.313238 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1304/2588] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:30.380159 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf8fa-2937-4e2a-9fad-36c9610d7a7e service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:30.385985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:30.386617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:30.386922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:30.387174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] PATH_INFO: `/v3/users/fb472ea8cce24a0db9bf9349345c1428` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:30.388364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb472ea8cce24a0db9bf9349345c1428)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:30.390273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:30.608391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb472ea8cce24a0db9bf9349345c1428'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:30.621742 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb472ea8cce24a0db9bf9349345c1428'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:30.628805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb472ea8cce24a0db9bf9349345c1428'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:30.632070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb472ea8cce24a0db9bf9349345c1428'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:30.711824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb472ea8cce24a0db9bf9349345c1428'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:30.724024 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1285/2589] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:30 2022] DELETE /identity/v3/users/fb472ea8cce24a0db9bf9349345c1428 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:30.726844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081f44-5b56-4e62-a610-c53929306edd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:30.727291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081f44-5b56-4e62-a610-c53929306edd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:30.727878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081f44-5b56-4e62-a610-c53929306edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:30.752862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-10081f44-5b56-4e62-a610-c53929306edd None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:30.754658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-10081f44-5b56-4e62-a610-c53929306edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:30.833620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1305/2590] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:30.848531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:30.848531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:30.906830 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:30.960489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2e14-cc57-4cdc-a3c6-5c549b4e00d1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:30.964098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:30.964707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:30.965046 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:30.965320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:30.974252 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:30.976468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:30.985828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1286/2591] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:31.575914 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081f44-5b56-4e62-a610-c53929306edd None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:31.577481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-10081f44-5b56-4e62-a610-c53929306edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:31.596212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081f44-5b56-4e62-a610-c53929306edd None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:31.601075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:31.601650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:31.601929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:31.602215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] PATH_INFO: `/v3/projects/211f4f2d53314f52ac266c6b8089bdeb` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:31.603441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211f4f2d53314f52ac266c6b8089bdeb)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:31.605361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:31.709949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211f4f2d53314f52ac266c6b8089bdeb', 'request_id': 'req-4742f5ee-3589-4510-aef6-1eb972dab465'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:31.716188 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211f4f2d53314f52ac266c6b8089bdeb', 'request_id': 'req-4742f5ee-3589-4510-aef6-1eb972dab465'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:31.721792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211f4f2d53314f52ac266c6b8089bdeb', 'request_id': 'req-4742f5ee-3589-4510-aef6-1eb972dab465'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:31.790491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:31.794391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] The token cache is being invalidate because project 211f4f2d53314f52ac266c6b8089bdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:31.794683 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:31.795338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:31.796898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1306/2592] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:31 2022] DELETE /identity/v3/projects/211f4f2d53314f52ac266c6b8089bdeb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:31.801098 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:31.811897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226d27-9166-424e-822a-f8d20373b66f service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:31.868557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:31.869190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:31.869465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:31.869738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] PATH_INFO: `/v3/users/928534c15c7246fb9c2b190751318e35` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:31.870833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928534c15c7246fb9c2b190751318e35)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:31.872780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:32.086707 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928534c15c7246fb9c2b190751318e35'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.099126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928534c15c7246fb9c2b190751318e35'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.107319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928534c15c7246fb9c2b190751318e35'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.108946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928534c15c7246fb9c2b190751318e35'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.160902 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f3228213-d5a7-48c6-8c05-d79402542096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928534c15c7246fb9c2b190751318e35'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.168354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1287/2593] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:31 2022] DELETE /identity/v3/users/928534c15c7246fb9c2b190751318e35 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:32.640541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:32.640541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:32.658161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5ee-3589-4510-aef6-1eb972dab465 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:32.721266 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:32.721978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:32.722253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:32.722552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] PATH_INFO: `/v3/projects/9f1e2282872949b797a2216a7da6b1f4` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:32.723871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1e2282872949b797a2216a7da6b1f4)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:32.727322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:32.824382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1e2282872949b797a2216a7da6b1f4', 'request_id': 'req-6334987f-c805-464d-8968-cc66cc06c763'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.830951 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1e2282872949b797a2216a7da6b1f4', 'request_id': 'req-6334987f-c805-464d-8968-cc66cc06c763'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.836790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1e2282872949b797a2216a7da6b1f4', 'request_id': 'req-6334987f-c805-464d-8968-cc66cc06c763'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.915461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] The token cache is being invalidate because project 9f1e2282872949b797a2216a7da6b1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:32.915760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.916441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-6334987f-c805-464d-8968-cc66cc06c763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:32.918181 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1307/2594] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:32 2022] DELETE /identity/v3/projects/9f1e2282872949b797a2216a7da6b1f4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:32.922897 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:32.923423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:32.923423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:32.945514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:32.946772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:32.992099 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:33.006599 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1288/2595] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:33.014515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.014857 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.015138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.035374 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:33.036615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:33.045201 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1308/2596] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:33.049527 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.059804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7438-147d-4d7f-87e8-db6c13982988 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.064439 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.065035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.065309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.065577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.066211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:33.066508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.068109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.083114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1289/2597] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:33.085242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.094706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730c2e-73e2-415c-b3f2-16a4bc0c6737 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.099280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.099876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.100242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.101073 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.101697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.103574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.219562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1309/2598] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:33.223790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.235044 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a62e-e78d-4067-b36b-01b7dc51d7aa admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.303266 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.303992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.304295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.304569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.305709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.307780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.417863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1290/2599] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:33.422243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.432948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9fea-c4f6-4fef-920a-cf395bb97d9b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.437593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.438184 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.438460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.438732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.439361 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.440975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.453677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1310/2600] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:33.463329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.473658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522821-8f14-4be6-a1ac-6ea81817c213 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.478652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.479268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.479550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.479854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.480542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.482231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e1b0b-e0c2-440f-b7a6-d82ae66eb7a5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.494097 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1291/2601] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:33.498487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.509631 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143670-e383-4630-9ac2-1ef5d7d5dbf2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.514431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.515116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.515399 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.515678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] PATH_INFO: `/v3/projects/3206898f7c0947f491cabc4f857f7056/users/615604b7b4924443903498aa0f62626f/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.532329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3206898f7c0947f491cabc4f857f7056, user_id=615604b7b4924443903498aa0f62626f, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.534917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.611689 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1311/2602] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:33 2022] PUT /identity/v3/projects/3206898f7c0947f491cabc4f857f7056/users/615604b7b4924443903498aa0f62626f/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:33.622469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.622747 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.623026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.651540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] MFA Rules not processed for user `615604b7b4924443903498aa0f62626f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:33.655082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:33.719831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1292/2603] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:33.724457 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.756324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:33.788124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45375-1881-47e2-bd03-d2f45b2ae352 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.792824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.793424 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.793704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.793979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.794602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.796708 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:33.894381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1312/2604] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:33.898161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:33.909217 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6e55b-36f6-404e-ab49-7b14808204c5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:33.953268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:33.967570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:33.967570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:33.967570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:33.967973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:33.968336 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:33.970224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.121278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1293/2605] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:33 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:34.128597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.140252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dec7-4bbe-4c2b-b662-a9f35760349f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.145246 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.145929 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.146217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.146491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.147129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.148986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.159656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1313/2606] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:34.163995 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.175236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14912a-e241-47c3-9553-72aa02705911 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.180506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.181173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.181459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.181739 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] PATH_INFO: `/v3/projects/05a07440031542538ca7685e9d65c705/users/a18170daea4e47b0a6d6d04f5107ec8f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.200604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a07440031542538ca7685e9d65c705, user_id=a18170daea4e47b0a6d6d04f5107ec8f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.205986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.327857 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1294/2607] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:34 2022] PUT /identity/v3/projects/05a07440031542538ca7685e9d65c705/users/a18170daea4e47b0a6d6d04f5107ec8f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:34.332025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.343375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0f98-4953-4fbb-abd0-65f3d0155a23 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.420456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.421299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.421674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.422043 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.423108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.424642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe46c-6005-4bd2-bbe4-016899661933 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.437882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1314/2608] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:34.442141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.456873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e8f59-03a7-4188-892a-f08316502365 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.464991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.465988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.466364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.466774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] PATH_INFO: `/v3/projects/05a07440031542538ca7685e9d65c705/users/a18170daea4e47b0a6d6d04f5107ec8f/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.469597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a07440031542538ca7685e9d65c705, user_id=a18170daea4e47b0a6d6d04f5107ec8f, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.472606 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.486470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1295/2609] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:34 2022] PUT /identity/v3/projects/05a07440031542538ca7685e9d65c705/users/a18170daea4e47b0a6d6d04f5107ec8f/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:34.498158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.498481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.498705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.546893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] MFA Rules not processed for user `a18170daea4e47b0a6d6d04f5107ec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:34.548288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:34.644377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1315/2610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:34.655040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.657110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:34.716421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357e6ee-976b-40f2-b8a4-32de4dce118a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.721617 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.722412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.722843 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.723122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.733945 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.735395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.748124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1296/2611] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:34.859122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:34.870025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4d660-6e69-4b20-bd51-00e65da20823 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:34.873956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:34.874994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:34.875239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:34.875517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:34.895225 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:34.938376 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:34.939900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9160-8ec7-4e1f-9450-d0d00c42d094 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:34.949887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1316/2612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:38.121653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:38.212937 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973c2-6387-4e16-a951-be8a770b3d37 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:38.217652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:38.218334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:38.218612 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:38.219430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] PATH_INFO: `/v3/users/615604b7b4924443903498aa0f62626f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:38.220127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615604b7b4924443903498aa0f62626f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:38.222039 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:38.519889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:38.522233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615604b7b4924443903498aa0f62626f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:38.535366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615604b7b4924443903498aa0f62626f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:38.544071 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615604b7b4924443903498aa0f62626f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:38.544999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615604b7b4924443903498aa0f62626f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:38.640835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615604b7b4924443903498aa0f62626f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:38.647889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1297/2613] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:38 2022] DELETE /identity/v3/users/615604b7b4924443903498aa0f62626f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:38.652609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:38.653065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:38.653159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:38.672810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:38.680840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:38.733024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1317/2614] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:38.744158 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:38.745632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:38.810108 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a126-dee8-4093-81c8-cce5f175af84 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:38.816884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:38.817499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:38.817776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:38.818073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:38.827774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:38.840748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:38.840748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1298/2615] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:39.427335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:39.428853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:39.441945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ab54-1a1d-4bb8-bb32-43207fca1be4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:39.447349 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:39.448053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:39.448333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:39.448605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] PATH_INFO: `/v3/projects/3206898f7c0947f491cabc4f857f7056` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:39.449738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3206898f7c0947f491cabc4f857f7056)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:39.451703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:39.551154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3206898f7c0947f491cabc4f857f7056', 'request_id': 'req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.557931 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3206898f7c0947f491cabc4f857f7056', 'request_id': 'req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.563766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3206898f7c0947f491cabc4f857f7056', 'request_id': 'req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.629487 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] The token cache is being invalidate because project 3206898f7c0947f491cabc4f857f7056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:39.629790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.630452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.632212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1318/2616] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:39 2022] DELETE /identity/v3/projects/3206898f7c0947f491cabc4f857f7056 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:39.636931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:39.647294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b78c5-95e9-46f4-a180-7d5444d58014 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:39.705069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:39.705813 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:39.706122 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:39.706374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] PATH_INFO: `/v3/users/a18170daea4e47b0a6d6d04f5107ec8f` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:39.707499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18170daea4e47b0a6d6d04f5107ec8f)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:39.709619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:39.855014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18170daea4e47b0a6d6d04f5107ec8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.867058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18170daea4e47b0a6d6d04f5107ec8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.869296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:39.875633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18170daea4e47b0a6d6d04f5107ec8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.876346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18170daea4e47b0a6d6d04f5107ec8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.955091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5814f460-6ced-4e51-b76b-f9bf43549a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18170daea4e47b0a6d6d04f5107ec8f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:39.961603 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1299/2617] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:39 2022] DELETE /identity/v3/users/a18170daea4e47b0a6d6d04f5107ec8f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:40.448431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:40.450077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:40.473317 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3740-f3a4-4fc4-9a1c-16dedc280be4 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:40.524675 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:40.541657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:40.542291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:40.542569 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:40.542886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] PATH_INFO: `/v3/projects/05a07440031542538ca7685e9d65c705` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:40.544144 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a07440031542538ca7685e9d65c705)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:40.552152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:40.676480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a07440031542538ca7685e9d65c705', 'request_id': 'req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:40.683107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a07440031542538ca7685e9d65c705', 'request_id': 'req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:40.690039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a07440031542538ca7685e9d65c705', 'request_id': 'req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:40.788980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] The token cache is being invalidate because project 05a07440031542538ca7685e9d65c705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:40.789270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:40.790616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-75ae1bc2-cf15-4a64-9efc-4fe69b0d3303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:40.792234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1319/2618] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:40 2022] DELETE /identity/v3/projects/05a07440031542538ca7685e9d65c705 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:40.797216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:40.797703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:40.797786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:40.817694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:40.818915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:40.880314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1300/2619] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:40.888488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:40.888774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:40.889049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:40.908911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:40.910098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:40.918239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1320/2620] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:40.927330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:40.937331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba24841-a38c-4755-8a84-96ab254cfa8c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:40.942028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:40.947582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:40.958303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1301/2621] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:40.963199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:40.972295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444c6b-91ad-4fb3-bf51-7e2a798aafe1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:40.979166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:40.979166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:40.979166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:40.979166 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:40.979556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:40.980880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.062795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1321/2622] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:40 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:41.063870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.075671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90bb3f-c911-430c-bfdc-0decc881ee1a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.132622 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.133229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.133511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.134309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.134955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.136961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.223821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1302/2623] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:41 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:41.228243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.238544 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e7608-a679-4a9e-a01d-53144f9f01bd admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.243723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.244362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.244642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.244910 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.245543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.247141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.256957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1322/2624] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:41.261698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.271931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab29a-5a55-4ef2-8b0d-386d9bc566b6 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.276844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.277468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.279505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.279505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.279505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.280288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b34283-6a99-4988-bcc3-f9319b7e1472 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.291654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1303/2625] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:41.295938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.306954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ec62-7ef5-4c7b-8288-3529863e9634 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.311620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.312295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.312576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.312898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] PATH_INFO: `/v3/projects/4cc32173bea341d6b2f4314db98fd03f/users/b7ff9e74bc4d40d6bed3de7905da1d25/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.450054 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc32173bea341d6b2f4314db98fd03f, user_id=b7ff9e74bc4d40d6bed3de7905da1d25, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.453016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.529754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1323/2626] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:41 2022] PUT /identity/v3/projects/4cc32173bea341d6b2f4314db98fd03f/users/b7ff9e74bc4d40d6bed3de7905da1d25/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:41.544957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.544957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.544957 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.589952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] MFA Rules not processed for user `b7ff9e74bc4d40d6bed3de7905da1d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:41.591259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:41.592133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.594515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:41.632910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:41.664775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1304/2627] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:41.670015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.670146 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bcc-1855-4ed9-a2ac-629bbf7d21c1 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.676372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.679274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.679274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.679274 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.679948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:41.709186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:41.735903 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adbf7-257f-458c-9e29-a157407a1c7c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.740476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.741085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.741367 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.741642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.742277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.744819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.747303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.748385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:41.758538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1324/2628] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:41.871368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1305/2629] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:41 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:41.876871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:41.885649 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abbd85-2da7-4905-a42e-7fbe83d63299 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:41.957281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:41.957904 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:41.958180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:41.958452 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:41.959087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:41.961042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.060453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1325/2630] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:41 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:42.064635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.077745 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f015f-ea40-4004-87c7-285c6cbeee85 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.082780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.083808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.083808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.084535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.085371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.089526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.099133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1306/2631] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:42.104008 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.114281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb927-a029-41cb-9dac-b5a7fa37a85d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.120310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.121576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.121576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.121576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] PATH_INFO: `/v3/projects/98b21acc273c40f18f2ccb27eb2fb156/users/e62652bf9d2140849943eda85ded1ff8/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.139543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b21acc273c40f18f2ccb27eb2fb156, user_id=e62652bf9d2140849943eda85ded1ff8, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.142316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.247832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1326/2632] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:42 2022] PUT /identity/v3/projects/98b21acc273c40f18f2ccb27eb2fb156/users/e62652bf9d2140849943eda85ded1ff8/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:42.252238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.262914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7b3a-0774-4ade-8f19-2fd53b06a0eb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.328519 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.329143 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.329428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.329835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.330553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.332165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea4de-f6b6-4ef2-8507-26eb2685978b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.342982 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1307/2633] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:42.347096 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.359192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2628-30d4-442a-8c06-268b5817c46d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.363778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.365508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.365508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.365508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] PATH_INFO: `/v3/projects/98b21acc273c40f18f2ccb27eb2fb156/users/e62652bf9d2140849943eda85ded1ff8/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.367431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b21acc273c40f18f2ccb27eb2fb156, user_id=e62652bf9d2140849943eda85ded1ff8, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.370135 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.381647 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1327/2634] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:42 2022] PUT /identity/v3/projects/98b21acc273c40f18f2ccb27eb2fb156/users/e62652bf9d2140849943eda85ded1ff8/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:42.393900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.394188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.394466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.424421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] MFA Rules not processed for user `e62652bf9d2140849943eda85ded1ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:42.425639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:42.463905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:42.494066 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1308/2635] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:42.506596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.508534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:42.578115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a113a-915a-4f74-bcb2-53fe4749ac29 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.587351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.587999 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.589094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.589515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.602337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.604287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f16658-77a2-4b68-afda-baab2c59e403 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:42.625779 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1328/2636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:42.761828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:42.838215 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4743-f05d-4d95-8835-51035d2146d6 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:42.845556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:42.846515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:42.846800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:42.847077 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] PATH_INFO: `/v3/users/b7ff9e74bc4d40d6bed3de7905da1d25` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:42.848337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ff9e74bc4d40d6bed3de7905da1d25)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:42.850594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:43.064259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ff9e74bc4d40d6bed3de7905da1d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:43.077260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ff9e74bc4d40d6bed3de7905da1d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:43.084459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ff9e74bc4d40d6bed3de7905da1d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:43.085171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ff9e74bc4d40d6bed3de7905da1d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:43.165797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ff9e74bc4d40d6bed3de7905da1d25'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:43.173810 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1309/2637] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:42 2022] DELETE /identity/v3/users/b7ff9e74bc4d40d6bed3de7905da1d25 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:43.178419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:43.178710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:43.178991 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:43.198829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:43.200153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:43.209378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:43.276961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1329/2638] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:43.282703 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:43.283837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:43.347844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3af08e-64d6-43c1-81ce-4116f1b8aa1f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:43.351832 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:43.352475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:43.352757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:43.353030 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:43.361303 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:43.366460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:43.368291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:43.379698 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1310/2639] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:16:43.846853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:43.846853 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:43.856480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0de91d-7b1a-49d1-afae-7772f7da353d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:43.862710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:43.863596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:43.863878 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:43.864202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] PATH_INFO: `/v3/projects/4cc32173bea341d6b2f4314db98fd03f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:43.865690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc32173bea341d6b2f4314db98fd03f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:43.867950 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:44.012223 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc32173bea341d6b2f4314db98fd03f', 'request_id': 'req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.018930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc32173bea341d6b2f4314db98fd03f', 'request_id': 'req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.025085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc32173bea341d6b2f4314db98fd03f', 'request_id': 'req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.098170 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] The token cache is being invalidate because project 4cc32173bea341d6b2f4314db98fd03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:44.098854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.099509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.101331 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1330/2640] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:43 2022] DELETE /identity/v3/projects/4cc32173bea341d6b2f4314db98fd03f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:44.106023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:44.118383 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850ba0-e990-4648-8a89-a6f9b0230e0e service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:44.187036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:44.188577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:44.188577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:44.190295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] PATH_INFO: `/v3/users/e62652bf9d2140849943eda85ded1ff8` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:44.190295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62652bf9d2140849943eda85ded1ff8)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:44.192468 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:44.354754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62652bf9d2140849943eda85ded1ff8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.367582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62652bf9d2140849943eda85ded1ff8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.376280 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62652bf9d2140849943eda85ded1ff8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.377265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62652bf9d2140849943eda85ded1ff8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.468976 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a932dee9-8af6-4798-b334-b8470dd31b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62652bf9d2140849943eda85ded1ff8'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:44.475515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1311/2641] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:44 2022] DELETE /identity/v3/users/e62652bf9d2140849943eda85ded1ff8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:44.955013 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:44.959483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:44.978687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7db6-7ad3-4cb9-8b9f-a8d715421afc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.059311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.060039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.060267 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.060542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] PATH_INFO: `/v3/projects/98b21acc273c40f18f2ccb27eb2fb156` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.061678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b21acc273c40f18f2ccb27eb2fb156)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.063838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.192520 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:45.200212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b21acc273c40f18f2ccb27eb2fb156', 'request_id': 'req-e13e882a-239a-4c85-89ad-2e703c9f5659'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.207561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b21acc273c40f18f2ccb27eb2fb156', 'request_id': 'req-e13e882a-239a-4c85-89ad-2e703c9f5659'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.214869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b21acc273c40f18f2ccb27eb2fb156', 'request_id': 'req-e13e882a-239a-4c85-89ad-2e703c9f5659'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.320429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] The token cache is being invalidate because project 98b21acc273c40f18f2ccb27eb2fb156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:45.321822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.334908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e13e882a-239a-4c85-89ad-2e703c9f5659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.340084 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1331/2642] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:44 2022] DELETE /identity/v3/projects/98b21acc273c40f18f2ccb27eb2fb156 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:45.344257 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.344656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.344807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.366450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:45.368007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:45.430898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1312/2643] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:45.438980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.439375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.439740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.460042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:45.461254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:45.469548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1332/2644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:45.478618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.484567 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4915d1-635b-4a29-b0c7-7d7740863683 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.489619 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.490297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.490686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.491117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.491827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:45.492251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.495196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.507650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1313/2645] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:45.512113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.521350 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2385-c1bb-447b-92ae-3aeff8ed3e42 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.526261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.526872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.527150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.527560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.528080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.529969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.646577 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.648484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:45.657256 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:45.661056 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1333/2646] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:45 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:45.664134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a00cd-a888-408f-be51-9a025b9e727a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.665154 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.723045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.723805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.724259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.724610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] PATH_INFO: `/v3/users/91c021bd2d524d16b5b3f11a2dab8b56` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.725783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c021bd2d524d16b5b3f11a2dab8b56)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.726635 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b70ba-8e81-4a7f-981e-f38f42a141db admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.727706 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.731869 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.732491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.732764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.733032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.733645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.736854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.848643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1334/2647] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:45 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:45.852528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.863892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043ec1-ce76-4daa-bd6c-a98f97c064b6 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.868767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.869980 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.870270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.870538 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.871192 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.872787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.884161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1335/2648] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:45.888767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.898870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594fbd2-c0a8-44f6-b562-6839bab277b2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.903507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.904145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.904423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.904694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.905323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.906891 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:45.921600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1336/2649] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:45.922470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:45.932937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616db8d-0486-41e6-8e8f-46cf2792af2b admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:45.933441 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c021bd2d524d16b5b3f11a2dab8b56'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.937859 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:45.938516 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:45.938797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:45.939086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] PATH_INFO: `/v3/projects/fbe54f15dc924bfa95f8d83420d6bd6e/users/4427d4a7516e4051a56d2425185c3664/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:45.946192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c021bd2d524d16b5b3f11a2dab8b56'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.953982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe54f15dc924bfa95f8d83420d6bd6e, user_id=4427d4a7516e4051a56d2425185c3664, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:45.955405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c021bd2d524d16b5b3f11a2dab8b56'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.956262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c021bd2d524d16b5b3f11a2dab8b56'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:45.961021 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4ce93-51eb-4691-8390-39d0efaf1d96 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.029404 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c021bd2d524d16b5b3f11a2dab8b56'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.035311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1337/2650] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:45 2022] PUT /identity/v3/projects/fbe54f15dc924bfa95f8d83420d6bd6e/users/4427d4a7516e4051a56d2425185c3664/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:46.038837 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1314/2651] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:45 2022] DELETE /identity/v3/users/91c021bd2d524d16b5b3f11a2dab8b56 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:46.104927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.105388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.105672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.136441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] MFA Rules not processed for user `4427d4a7516e4051a56d2425185c3664`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:46.137710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.173741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:46.207499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1338/2652] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:46.212289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.213991 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.288565 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daf19-28bb-489e-b981-4bb6a378ab1d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.293838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.294446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.294721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.294992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.295618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.297544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.312545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.315326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.330473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926f73b-7da0-4559-b36b-5ab3e72b7612 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.335377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.336045 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.336370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.336657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] PATH_INFO: `/v3/projects/ea799e24da9f41f08abd32cc0b6a91d0` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.337894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea799e24da9f41f08abd32cc0b6a91d0)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.345714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.385876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1315/2653] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:46.390449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.401296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:46.453308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea799e24da9f41f08abd32cc0b6a91d0', 'request_id': 'req-28df079d-5505-41b2-8673-5660b07fa8f6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.462252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea799e24da9f41f08abd32cc0b6a91d0', 'request_id': 'req-28df079d-5505-41b2-8673-5660b07fa8f6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.469536 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea799e24da9f41f08abd32cc0b6a91d0', 'request_id': 'req-28df079d-5505-41b2-8673-5660b07fa8f6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.472992 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604ed0-8740-4201-a3ff-8f94944b370a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.533869 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.534484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.534774 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.535050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.535661 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.536620 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] The token cache is being invalidate because project ea799e24da9f41f08abd32cc0b6a91d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:16:46.536927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.539808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-28df079d-5505-41b2-8673-5660b07fa8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:46.540121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.543088 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1339/2654] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:16:46 2022] DELETE /identity/v3/projects/ea799e24da9f41f08abd32cc0b6a91d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:46.544450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da790a-b025-4e35-b97d-eb202df7066c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.544738 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da790a-b025-4e35-b97d-eb202df7066c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.545018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da790a-b025-4e35-b97d-eb202df7066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.569893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f1da790a-b025-4e35-b97d-eb202df7066c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:46.571104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f1da790a-b025-4e35-b97d-eb202df7066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.579730 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1340/2655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:46.587925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.588877 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.589214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.613537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:46.614714 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.623350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1316/2656] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:46.624215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1341/2657] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:46.627334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.628408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.628984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:46.638100 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990a947-ebcf-4b47-b2bd-ff6422907d30 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.640693 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde00799-4a77-44f8-9eb9-d55ee3653602 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.644335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.644967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.645372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.645654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.646323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:16:46.646450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.646626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.647038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.647314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.647582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.648265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.648470 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.649836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.669355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1342/2658] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:16:46.674180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1317/2659] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:46.675245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.677954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.686006 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82baa8-57a1-4f59-8a39-d6879c63d725 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.688261 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3817-47c3-4499-bc8e-9257d426d0dc admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.692834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.693482 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.693658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.693794 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.694018 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] PATH_INFO: `/v3/projects/ee977d181ea74f578f9f73c98c973348/users/28c0ebb998554d77abf594c339b402b5/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.698252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.698252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.700481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.700481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.701501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.710827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee977d181ea74f578f9f73c98c973348, user_id=28c0ebb998554d77abf594c339b402b5, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.714222 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.793907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1318/2660] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:46 2022] PUT /identity/v3/projects/ee977d181ea74f578f9f73c98c973348/users/28c0ebb998554d77abf594c339b402b5/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:46.797720 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.819944 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1343/2661] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:46.823571 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.863295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68badf94-0d70-454c-8264-b4ce6d20fc56 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.878062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:46.889390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b434cc-4a13-4af3-b7fa-e703833662d9 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.898028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.898028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.898028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.898028 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.898366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.899171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.924947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.925649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.925994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.926273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.926916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.928534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.939278 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1319/2662] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:46.943400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:46.953314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e06efe-bbfe-4407-b3c2-4923d1ef386f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:46.957790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:46.958400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.958676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.958949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] PATH_INFO: `/v3/projects/ee977d181ea74f578f9f73c98c973348/users/28c0ebb998554d77abf594c339b402b5/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.960895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee977d181ea74f578f9f73c98c973348, user_id=28c0ebb998554d77abf594c339b402b5, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:46.964047 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7c06-44c2-49c8-9d04-390bab89f0a6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:46.979420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1320/2663] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:46 2022] PUT /identity/v3/projects/ee977d181ea74f578f9f73c98c973348/users/28c0ebb998554d77abf594c339b402b5/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:16:46.988357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:46.988641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:46.988911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:46.995766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:47.003221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1344/2664] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:47.007283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.017939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080d5f-9275-46f6-9400-480bd834ead3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.018130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] MFA Rules not processed for user `28c0ebb998554d77abf594c339b402b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:47.019137 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:47.073419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.074029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.074334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.074602 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.075232 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.076826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.086805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1345/2665] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:47.093371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1321/2666] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:16:47.093508 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.117460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00b92c-ae80-4ed4-9813-5eec87acbc35 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.117604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.117735 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.117873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:47.117969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.117969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.117969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.117969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.117969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.129129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1346/2667] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:47.129994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.141093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62f48c-7d9a-4336-802a-1ae500fa53d9 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.146075 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.146729 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.147011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.147289 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] PATH_INFO: `/v3/projects/b38b2e526c234a2f9dd0b96ccf478be6/users/c94f0df3304444378b949787143e1817/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.163501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38b2e526c234a2f9dd0b96ccf478be6, user_id=c94f0df3304444378b949787143e1817, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.166132 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.179275 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefbd53-848c-4ebd-bf28-595f244abb5f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.183973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.184608 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.184889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.185163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.186919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:47.244017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.246674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16a757-94ed-43e3-8066-bfa1000d15bf service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.256227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1322/2668] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:47.293928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1347/2669] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:47 2022] PUT /identity/v3/projects/b38b2e526c234a2f9dd0b96ccf478be6/users/c94f0df3304444378b949787143e1817/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:47.304623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.304911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.305191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.311521 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:47.338580 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] MFA Rules not processed for user `c94f0df3304444378b949787143e1817`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:47.339855 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:47.411231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1323/2670] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:47.412245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.473829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc127b-ca47-4fff-b0ef-7b70671ec783 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.478418 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.479553 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.479832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.480183 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.480835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.482715 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.591615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1348/2671] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:16:47 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:16:47.595760 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.609106 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150940e-54c7-46b2-8851-9845198d0dc4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.667847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.668427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.668710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.668984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.669626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.671605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.783895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1324/2672] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:16:47 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:16:47.787902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.798369 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76999d-a81f-434a-a41e-31dfdc70eb13 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.802804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.808057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.808057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.808057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.808057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.808057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.817463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1349/2673] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:16:47.821613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.833052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459a99-6d93-42bf-a026-524208364ec5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.837784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:47.841569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:47.841569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:47.841569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] PATH_INFO: `/v3/projects/2fae15c1e272465c893303104deee37a/users/0a785381d9844955b35c9ca4f06a6f53/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:47.856708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fae15c1e272465c893303104deee37a, user_id=0a785381d9844955b35c9ca4f06a6f53, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:47.859333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:47.938968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1325/2674] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:47 2022] PUT /identity/v3/projects/2fae15c1e272465c893303104deee37a/users/0a785381d9844955b35c9ca4f06a6f53/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:47.942790 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:47.952710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28778-5ea5-4868-9095-d7095c08afbc admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:47.985749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:48.011606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:48.012254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.012533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.012810 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.013466 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:48.015062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e36a5-94dc-41ba-a7ec-7114702f6d07 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:48.026765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1350/2675] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:16:48.030412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:48.040856 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f09f-24c3-4599-8050-7cc3ccbeac99 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:48.045873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:48.046525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.046834 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.047107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] PATH_INFO: `/v3/projects/2fae15c1e272465c893303104deee37a/users/0a785381d9844955b35c9ca4f06a6f53/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.049102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fae15c1e272465c893303104deee37a, user_id=0a785381d9844955b35c9ca4f06a6f53, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:48.051801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:48.063462 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1326/2676] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:16:48 2022] PUT /identity/v3/projects/2fae15c1e272465c893303104deee37a/users/0a785381d9844955b35c9ca4f06a6f53/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:48.075829 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.076164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.076445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.104233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] MFA Rules not processed for user `0a785381d9844955b35c9ca4f06a6f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:48.105453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:48.173279 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1351/2677] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:48.185639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:48.187420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:48.211036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:48.249996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d25ef-7103-4212-9ae5-addacf6c6bc2 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:48.253836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:48.254443 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.254746 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.255023 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.268078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:48.269726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:48.281147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1327/2678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:48.442605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:48.452758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ffdb-8f65-4bec-8895-8167c54eeebc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:48.456726 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:48.457295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.457570 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.457883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.515337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:48.516801 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:48.525720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1352/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:48.764548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:48.773590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff8b2a-b772-4469-a787-392c772e2c8c service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:48.777581 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:48.786076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:48.786076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:48.786076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:48.786076 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:48.849522 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:48.850973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:48.861366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1328/2680] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:52.771163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:52.779928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2df7-bcb1-4ad7-9379-6674d2f7d5bd service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:52.783511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:52.784133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:52.784416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:52.784682 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:52.835012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:52.847908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:52.849610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c827-3d36-4a94-b26f-45fedfd3f6b2 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:52.859537 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1353/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:16:58.857863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=47 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:59.031807 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:59.099334 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188faf8e-cf39-4b47-b2f6-50f3b556c13e service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:59.104126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:59.104799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:59.105074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:59.105342 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] PATH_INFO: `/v3/users/4427d4a7516e4051a56d2425185c3664` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:59.106572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4427d4a7516e4051a56d2425185c3664)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:59.108553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:59.402411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4427d4a7516e4051a56d2425185c3664'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:59.415907 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4427d4a7516e4051a56d2425185c3664'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:59.424916 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4427d4a7516e4051a56d2425185c3664'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:59.425676 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4427d4a7516e4051a56d2425185c3664'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:59.521142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4427d4a7516e4051a56d2425185c3664'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:16:59.530196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1329/2682] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:16:59 2022] DELETE /identity/v3/users/4427d4a7516e4051a56d2425185c3664 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:16:59.533152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:59.533661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:59.533768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:59.555257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:16:59.556761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:59.615680 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1354/2683] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:16:59.625423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:16:59.626814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:16:59.698014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa2ff-df29-4c57-8528-f9fd88fc0e1b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:16:59.704170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:16:59.704783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:16:59.705059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:16:59.705327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:16:59.714789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:16:59.716893 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:16:59.726472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1330/2684] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:00.435643 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:00.437755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:00.449966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93051-ad63-40ea-a775-a92c84daf6a7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:00.456867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:00.456867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:00.456867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:00.456867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] PATH_INFO: `/v3/projects/fbe54f15dc924bfa95f8d83420d6bd6e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:00.461677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe54f15dc924bfa95f8d83420d6bd6e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:00.461677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:00.589634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe54f15dc924bfa95f8d83420d6bd6e', 'request_id': 'req-dcb95f56-1360-4507-9204-58dc6b91c060'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.596409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe54f15dc924bfa95f8d83420d6bd6e', 'request_id': 'req-dcb95f56-1360-4507-9204-58dc6b91c060'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.602167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe54f15dc924bfa95f8d83420d6bd6e', 'request_id': 'req-dcb95f56-1360-4507-9204-58dc6b91c060'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.667398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] The token cache is being invalidate because project fbe54f15dc924bfa95f8d83420d6bd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:00.667684 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.668314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.670488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1355/2685] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:00 2022] DELETE /identity/v3/projects/fbe54f15dc924bfa95f8d83420d6bd6e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:00.674556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:00.685154 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc732-45e9-4cf5-9387-766fdd4b11f8 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:00.703572 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:00.741839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:00.742480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:00.742776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:00.743036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] PATH_INFO: `/v3/users/28c0ebb998554d77abf594c339b402b5` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:00.744189 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c0ebb998554d77abf594c339b402b5)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:00.751123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:00.945059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c0ebb998554d77abf594c339b402b5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.959004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c0ebb998554d77abf594c339b402b5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.965963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c0ebb998554d77abf594c339b402b5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:00.966820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c0ebb998554d77abf594c339b402b5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.046191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-988c3334-e79b-4a79-a706-15e715b5d6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c0ebb998554d77abf594c339b402b5'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.052501 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1331/2686] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:00 2022] DELETE /identity/v3/users/28c0ebb998554d77abf594c339b402b5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:01.517321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:01.518732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:01.534883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95f56-1360-4507-9204-58dc6b91c060 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:01.593582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:01.594311 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:01.594478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:01.594749 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] PATH_INFO: `/v3/projects/ee977d181ea74f578f9f73c98c973348` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:01.595860 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee977d181ea74f578f9f73c98c973348)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:01.597769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:01.609862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:01.705598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee977d181ea74f578f9f73c98c973348', 'request_id': 'req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.712307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee977d181ea74f578f9f73c98c973348', 'request_id': 'req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.719016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee977d181ea74f578f9f73c98c973348', 'request_id': 'req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.800868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] The token cache is being invalidate because project ee977d181ea74f578f9f73c98c973348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:01.801182 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.801796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d3a6f8b0-b071-43b1-b387-6dc21e2ca3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:01.803276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1356/2687] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:01 2022] DELETE /identity/v3/projects/ee977d181ea74f578f9f73c98c973348 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:01.809717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:01.810247 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:01.810373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:01.830489 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:01.831695 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:01.894791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1332/2688] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:01.903113 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:01.903403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:01.903798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:01.923742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:01.924986 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:01.933016 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1357/2689] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:01.937906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:01.947621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8e94-e1ea-46df-a9d8-e1a9f833b6c2 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:01.952442 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:01.953041 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:01.953324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:01.953598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:01.954243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:01.954552 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:01.956233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:01.967753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1333/2690] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:17:01.972102 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:01.981119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8460c6-c40f-47bd-b8b2-3983819ecfc6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:01.986597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:01.987191 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:01.987465 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:01.987733 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:01.988396 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:01.990247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.065616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1358/2691] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:01 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:02.070167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:02.080426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3add14-e370-4291-8259-ec0dd700584d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:02.107658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:02.140657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:02.140657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.142961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.143271 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.143926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:02.145858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.222637 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1334/2692] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:02 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:02.223890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:02.234962 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aee07-f0c0-4230-b842-59d5cea9515a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:02.239509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:02.241694 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.241979 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.242252 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.243024 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:02.244525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.254941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1359/2693] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:02.259010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:02.271628 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bdeb-549b-497c-a472-1bf8869d69ff admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:02.276625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:02.277186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.277472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.277751 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.278975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:02.286959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f5994-c581-4755-b473-408483131f85 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.291454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1335/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:02.296202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:02.307032 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dca7b-fdf6-4581-a906-a8c4a61c8c84 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:02.312211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:02.312872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.313258 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.313541 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] PATH_INFO: `/v3/projects/7a0969ff93a846009f225dd815b8c54e/users/8a42aac1eb64485f93e16173f82973d4/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.328956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0969ff93a846009f225dd815b8c54e, user_id=8a42aac1eb64485f93e16173f82973d4, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:02.331672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.420346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1360/2695] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:02 2022] PUT /identity/v3/projects/7a0969ff93a846009f225dd815b8c54e/users/8a42aac1eb64485f93e16173f82973d4/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:02.433683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.434079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.434424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.463966 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] MFA Rules not processed for user `8a42aac1eb64485f93e16173f82973d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:02.465187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:02.529090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1336/2696] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:02.540053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:02.541923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:02.599502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da513-3708-4a31-80d9-77b9fc7cf5d7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:02.603064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:02.603663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:02.603940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:02.604230 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:02.613000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:02.614388 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:02.624037 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1361/2697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:12.525633 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:12.619213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:12.878846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:12.880733 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:12.953864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a236-cfc5-4578-8920-8ad8d9f6c72c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:12.959083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:12.959664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:12.959946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:12.960248 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] PATH_INFO: `/v3/users/8d7bb7c2df1846f3a5fa04142e34f6da` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:12.961453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7bb7c2df1846f3a5fa04142e34f6da)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:12.995570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:13.169909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7bb7c2df1846f3a5fa04142e34f6da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.182392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7bb7c2df1846f3a5fa04142e34f6da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.189227 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7bb7c2df1846f3a5fa04142e34f6da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.190049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7bb7c2df1846f3a5fa04142e34f6da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.274245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7bb7c2df1846f3a5fa04142e34f6da'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.284243 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1337/2698] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:12 2022] DELETE /identity/v3/users/8d7bb7c2df1846f3a5fa04142e34f6da => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:13.499882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:13.511854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec840-e525-464d-9f70-7bb0f66e1533 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:13.571263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:13.572000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:13.572240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:13.572513 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] PATH_INFO: `/v3/projects/31701e49183d43b1a9d44aa590c69110` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:13.573613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=31701e49183d43b1a9d44aa590c69110)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:13.575514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:13.686690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31701e49183d43b1a9d44aa590c69110', 'request_id': 'req-3d147aaa-a169-48e2-8c5b-fb49215ccacb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.693532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31701e49183d43b1a9d44aa590c69110', 'request_id': 'req-3d147aaa-a169-48e2-8c5b-fb49215ccacb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.699082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31701e49183d43b1a9d44aa590c69110', 'request_id': 'req-3d147aaa-a169-48e2-8c5b-fb49215ccacb'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.781826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] The token cache is being invalidate because project 31701e49183d43b1a9d44aa590c69110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:13.782117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.782740 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:13.784342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1362/2699] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:13 2022] DELETE /identity/v3/projects/31701e49183d43b1a9d44aa590c69110 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:13.788419 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:13.789844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:13.803641 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ae630-dfed-464e-adf6-87ec39ede66a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:13.861007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:13.862262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:13.862665 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:13.862861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] PATH_INFO: `/v3/users/55801ac185ba4803b33e2c4abb667d4c` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:13.864129 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55801ac185ba4803b33e2c4abb667d4c)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:13.873931 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:13.888852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:14.037348 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55801ac185ba4803b33e2c4abb667d4c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.050679 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55801ac185ba4803b33e2c4abb667d4c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.058425 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55801ac185ba4803b33e2c4abb667d4c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.059330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55801ac185ba4803b33e2c4abb667d4c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.126646 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55801ac185ba4803b33e2c4abb667d4c'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.139081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1338/2700] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:13 2022] DELETE /identity/v3/users/55801ac185ba4803b33e2c4abb667d4c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:14.336094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:14.337575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.350603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147aaa-a169-48e2-8c5b-fb49215ccacb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:14.404978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:14.405600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.405883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.406153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] PATH_INFO: `/v3/users/8a42aac1eb64485f93e16173f82973d4` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.407255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a42aac1eb64485f93e16173f82973d4)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:14.409861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:14.418535 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:14.420563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.436833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89287-9550-4f41-8f23-5b487856db72 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:14.442149 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:14.443750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.443750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.443750 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] PATH_INFO: `/v3/projects/1e4af79ed74e4d81909a6668f69fe680` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.449819 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4af79ed74e4d81909a6668f69fe680)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:14.451737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:14.609524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:14.623424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4af79ed74e4d81909a6668f69fe680', 'request_id': 'req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.627943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a42aac1eb64485f93e16173f82973d4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.641430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a42aac1eb64485f93e16173f82973d4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.648903 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a42aac1eb64485f93e16173f82973d4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.715382 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4af79ed74e4d81909a6668f69fe680', 'request_id': 'req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.722948 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4af79ed74e4d81909a6668f69fe680', 'request_id': 'req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.733878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] The token cache is being invalidate because project 1e4af79ed74e4d81909a6668f69fe680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:14.733878 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.734610 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-c80fb60a-e85e-49d3-a25c-1ed6979ae90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.736180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1339/2701] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:14 2022] DELETE /identity/v3/projects/1e4af79ed74e4d81909a6668f69fe680 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:14.741034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be646b-94b0-462c-81d7-1e5b8348ab0d None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.741324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be646b-94b0-462c-81d7-1e5b8348ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.741605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be646b-94b0-462c-81d7-1e5b8348ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.763416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-04be646b-94b0-462c-81d7-1e5b8348ab0d None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:14.764719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-04be646b-94b0-462c-81d7-1e5b8348ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.811116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a42aac1eb64485f93e16173f82973d4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.812104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7dd2be50-d2bf-4bef-bd8e-e2c45c94d075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a42aac1eb64485f93e16173f82973d4'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:14.819364 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1363/2702] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:14 2022] DELETE /identity/v3/users/8a42aac1eb64485f93e16173f82973d4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:14.824239 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.824604 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.824879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.845185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1340/2703] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:14.851432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:14.851432 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.858084 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.858373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.858861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.881349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:14.882512 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.902711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:14.914884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1364/2704] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:14.926509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:14.928404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:14.949971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1341/2705] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:14.954487 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:14.963890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19ac83-d7c2-4b3a-92a6-f24e93aa1182 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:14.968936 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:14.969555 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:14.969862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:14.970136 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:14.971467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:14.971767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:14.973509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:14.991343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1342/2706] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:17:14.992504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.002409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fc7a8-a54a-4ebc-8a79-ef86e77f6049 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.004427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e956f-0b4f-4243-9b3c-ef871c89c6f6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.009964 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.010403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.010749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.011059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.011333 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.011709 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.011963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.012329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.012756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.013881 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.023107 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.024560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.036747 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1365/2707] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:15.126578 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1343/2708] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:14 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:15.128139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.137763 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7e139-058e-4da0-aa89-02fb381a5bcc service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.186813 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:15.195700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.196351 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.196637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.196908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.197534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.199425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.286720 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1366/2709] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:15 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:15.291000 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.303316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054c82-0f94-4c5f-923e-09f246701462 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.310226 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.311027 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.311191 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.311393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.312478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.315331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.328393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1344/2710] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:15.333031 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.344584 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed11a-fb8d-4ec5-80df-241918876481 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.350485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.351149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.351425 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.351696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.352403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.354171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.366126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1367/2711] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:15.370230 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.388433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7edb-1cc1-4e55-a41c-a40bc565c3dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.388433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.388433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.388433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.388910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] PATH_INFO: `/v3/projects/d649b904c7a84233b690c8483084e5ff/users/9f190d878ee04e2487620b8fa6d67eb1/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.403556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d649b904c7a84233b690c8483084e5ff, user_id=9f190d878ee04e2487620b8fa6d67eb1, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.406269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5bc7-66ce-440b-a229-bff1798b1d0c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.456299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.458124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:15.473456 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f38d8-172c-4150-af53-332f58804422 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.478542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.486293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.486293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.486293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] PATH_INFO: `/v3/projects/7a0969ff93a846009f225dd815b8c54e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.486293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0969ff93a846009f225dd815b8c54e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.486293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.508711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1345/2712] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:15 2022] PUT /identity/v3/projects/d649b904c7a84233b690c8483084e5ff/users/9f190d878ee04e2487620b8fa6d67eb1/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:15.519842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.520160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.520437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.548570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] MFA Rules not processed for user `9f190d878ee04e2487620b8fa6d67eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:15.550325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:15.617885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1346/2713] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:15.620395 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0969ff93a846009f225dd815b8c54e', 'request_id': 'req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:15.628325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0969ff93a846009f225dd815b8c54e', 'request_id': 'req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:15.630101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.636486 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0969ff93a846009f225dd815b8c54e', 'request_id': 'req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:15.678986 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:15.697423 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d3b5-9796-4f1f-99f6-4eefefd0d9e8 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.714497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] The token cache is being invalidate because project 7a0969ff93a846009f225dd815b8c54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:15.714862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:15.721658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:15.721658 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1368/2714] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:15 2022] DELETE /identity/v3/projects/7a0969ff93a846009f225dd815b8c54e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:15.759020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11d74-f471-4569-992c-206303261832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.759650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11d74-f471-4569-992c-206303261832 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.759935 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11d74-f471-4569-992c-206303261832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.760265 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c11d74-f471-4569-992c-206303261832 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.760908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11d74-f471-4569-992c-206303261832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.762839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c11d74-f471-4569-992c-206303261832 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:15.865089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1347/2715] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:15 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:15.869167 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:15.870578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:15.885354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6f9b-90bd-4e32-83b7-9e63b2fb3edd admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:15.957898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:15.957898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:15.957898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:15.957898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:15.958439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:15.958439 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.039960 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1369/2716] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:15 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:16.043949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11d74-f471-4569-992c-206303261832 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:16.056424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c11d74-f471-4569-992c-206303261832 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:16.061564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:16.062188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.062518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.062812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.063463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:16.065894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.076848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1348/2717] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:17:16.081905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:16.091830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141259-0433-4633-b30f-930a567e4b93 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:16.097500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:16.101273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.101273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.101273 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] PATH_INFO: `/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68/users/234b087dd7b04afc8a674da4cee3bb88/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.113475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d250e3d40e1348f8bcd06bfab0f89e68, user_id=234b087dd7b04afc8a674da4cee3bb88, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:16.116171 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.184003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1370/2718] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:16 2022] PUT /identity/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68/users/234b087dd7b04afc8a674da4cee3bb88/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:16.187926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:16.197958 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691cfa8-ad4e-475c-b839-969cdb8d0b68 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:16.257786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:16.258320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.258594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.258866 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.259506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:16.261200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4273b-1e0f-4b56-bae9-02d6cae64c43 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.272495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1349/2719] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:16.276750 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:16.287233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9550-a688-42a1-a884-6e7697ffd684 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:16.291844 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:16.292526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.292800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.293068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] PATH_INFO: `/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68/users/234b087dd7b04afc8a674da4cee3bb88/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.294981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d250e3d40e1348f8bcd06bfab0f89e68, user_id=234b087dd7b04afc8a674da4cee3bb88, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:16.297611 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.307783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1371/2720] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:16 2022] PUT /identity/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68/users/234b087dd7b04afc8a674da4cee3bb88/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:16.319092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.320116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.320116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.347356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] MFA Rules not processed for user `234b087dd7b04afc8a674da4cee3bb88`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:16.348584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:16.397072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:16.418081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1350/2721] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:16.428912 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:16.430595 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:16.441072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=84,keystone:INSERT=9,keystone:DELETE=7 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:16.489645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9f5b7-ecd8-48c6-a444-41852468fc02 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:16.493293 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:16.493884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:16.494158 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:16.494423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:16.496165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:16.554321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:16.555732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ea874-710f-4a02-b819-93420ed429c2 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:16.564722 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1372/2722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:19.568515 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:19.631486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ed2ab-4e3b-4d82-add2-bd373e6d397b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:19.636175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:19.636805 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:19.637090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:19.637365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] PATH_INFO: `/v3/users/9f190d878ee04e2487620b8fa6d67eb1` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:19.638533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f190d878ee04e2487620b8fa6d67eb1)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:19.640485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:19.825408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f190d878ee04e2487620b8fa6d67eb1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:19.838008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f190d878ee04e2487620b8fa6d67eb1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:19.844915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f190d878ee04e2487620b8fa6d67eb1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:19.850645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f190d878ee04e2487620b8fa6d67eb1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:19.955514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f190d878ee04e2487620b8fa6d67eb1'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:19.962196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1351/2723] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:19 2022] DELETE /identity/v3/users/9f190d878ee04e2487620b8fa6d67eb1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:19.966662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:19.967126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:19.967250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:19.987739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:19.989862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:20.047062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1373/2724] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:20.058081 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:20.059517 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:20.118692 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4e385-3e94-48d4-a39e-c78ba50da95f admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:20.122338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:20.122940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:20.123219 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:20.123491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:20.132544 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:20.133975 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:20.143534 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1352/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:20.706010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:20.708139 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:20.720284 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980660b-021b-4eaf-953e-ac0e3ab591f7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:20.725773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:20.726423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:20.726743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:20.726965 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] PATH_INFO: `/v3/projects/d649b904c7a84233b690c8483084e5ff` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:20.728115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d649b904c7a84233b690c8483084e5ff)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:20.730093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:20.865414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd649b904c7a84233b690c8483084e5ff', 'request_id': 'req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:20.871600 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd649b904c7a84233b690c8483084e5ff', 'request_id': 'req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:20.873613 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:20.877757 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd649b904c7a84233b690c8483084e5ff', 'request_id': 'req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:20.978314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] The token cache is being invalidate because project d649b904c7a84233b690c8483084e5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:20.979034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:20.979179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:20.980616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1374/2726] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:20 2022] DELETE /identity/v3/projects/d649b904c7a84233b690c8483084e5ff => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:20.984734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:20.995192 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96c7c-a3f8-48ae-a7be-87487767a2fa service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:20.998954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:21.175797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:21.176497 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:21.176779 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:21.177056 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] PATH_INFO: `/v3/users/234b087dd7b04afc8a674da4cee3bb88` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:21.178162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234b087dd7b04afc8a674da4cee3bb88)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:21.180095 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:21.401808 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234b087dd7b04afc8a674da4cee3bb88'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:21.414451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234b087dd7b04afc8a674da4cee3bb88'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:21.421631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234b087dd7b04afc8a674da4cee3bb88'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:21.426324 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234b087dd7b04afc8a674da4cee3bb88'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:21.497780 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0e055152-1bc6-4551-b2ae-4ff57dd8d6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234b087dd7b04afc8a674da4cee3bb88'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:21.505059 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1353/2727] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:20 2022] DELETE /identity/v3/users/234b087dd7b04afc8a674da4cee3bb88 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:21.903854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:21.905299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:21.920667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2360d-8472-4ca8-9dbf-c2d2af2eb556 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:21.982851 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:21.983488 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:21.983789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:21.984115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] PATH_INFO: `/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:21.985231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d250e3d40e1348f8bcd06bfab0f89e68)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:21.987116 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.093323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd250e3d40e1348f8bcd06bfab0f89e68', 'request_id': 'req-d05db21e-df46-4640-8a0a-0430356e9179'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:22.100421 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd250e3d40e1348f8bcd06bfab0f89e68', 'request_id': 'req-d05db21e-df46-4640-8a0a-0430356e9179'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:22.107129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd250e3d40e1348f8bcd06bfab0f89e68', 'request_id': 'req-d05db21e-df46-4640-8a0a-0430356e9179'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:22.212941 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] The token cache is being invalidate because project d250e3d40e1348f8bcd06bfab0f89e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:22.213162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:22.213765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-d05db21e-df46-4640-8a0a-0430356e9179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:22.215243 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1375/2728] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:21 2022] DELETE /identity/v3/projects/d250e3d40e1348f8bcd06bfab0f89e68 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:22.220526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.221662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.221662 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.240389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:22.241574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:22.300147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1354/2729] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:22.308304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.308592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.308898 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.329129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:22.330341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:22.343245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1376/2730] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:22.347959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.358197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cb20-f584-41df-8979-b9cd23fa47df None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.362849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.363725 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.364032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.364314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.365043 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:22.365364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.366972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.379205 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1355/2731] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:17:22.383580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.393324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7020ef-e788-410e-9ff3-8af7db257e8f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.398938 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.401594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.401594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.401594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.401594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.402671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.498195 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1377/2732] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:22 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:22.498776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.508694 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540d59-748c-4902-a856-5fa098e05d9a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.517251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:22.563428 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.564049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.564332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.564601 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.565225 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.567727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.675658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1356/2733] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:22 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:22.679843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.690445 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d6cf-f819-408b-8aab-358535823406 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.695622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.696253 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.701329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.701329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.701329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.701329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.709648 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1378/2734] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:22.719358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.725858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33527ff3-4c0c-43c1-94cb-f1bbe0cb18c7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.731748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.731748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.731748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.731748 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.732244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.733809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd737c8-1365-44a4-848d-a17fe34868d4 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.744417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1357/2735] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:17:22.748650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:22.759014 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f5392-6cd5-4e6e-b32d-a0053b0309b1 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:22.763674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:22.764397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.764674 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.765042 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] PATH_INFO: `/v3/projects/5edddb876d5b42869f189a0ed6ad6036/users/a28631eb4c484c1a9e148f1f34367686/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.780346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edddb876d5b42869f189a0ed6ad6036, user_id=a28631eb4c484c1a9e148f1f34367686, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:22.782982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:22.909626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1379/2736] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:22 2022] PUT /identity/v3/projects/5edddb876d5b42869f189a0ed6ad6036/users/a28631eb4c484c1a9e148f1f34367686/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:22.921306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:22.921711 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:22.921996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:22.950167 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] MFA Rules not processed for user `a28631eb4c484c1a9e148f1f34367686`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:22.951387 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:23.014816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1358/2737] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:23.019429 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.031940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:23.080574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3345-e9e6-4c37-a1ff-847c8250f63c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.085105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.085700 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.085975 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.086244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.086866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.088761 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.185532 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1380/2738] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:23 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:23.189655 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.200594 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f2b41-c619-407b-b4c7-aae6c2ee0159 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.255970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.256645 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.256876 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.257148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.257782 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.259677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.359493 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1359/2739] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:23 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:23.363511 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.373807 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a4f8-c0e1-4e45-ad91-122f784e2d2c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.378480 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.379072 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.379355 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.379628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.380302 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.381993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.392459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1381/2740] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:23.396911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.406754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2398038-65d1-4543-86ec-966cec47bd4d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.412273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.412864 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.413145 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.413421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.414055 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.415631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3b101-b145-4da9-be1a-4fb6d744d24d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.420965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:23.426677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1360/2741] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:23.437400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.447451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb050be-1c43-49c0-bbce-cbbe3c97d959 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.452140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.452783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.453064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.453341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] PATH_INFO: `/v3/projects/04e6bbb9f2b04bdb9bbd8db911daa808/users/4adb750355c1415983020568ab52314d/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.468172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e6bbb9f2b04bdb9bbd8db911daa808, user_id=4adb750355c1415983020568ab52314d, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.470746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.515378 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1382/2742] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:23 2022] PUT /identity/v3/projects/04e6bbb9f2b04bdb9bbd8db911daa808/users/4adb750355c1415983020568ab52314d/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:23.528373 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.528663 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.528939 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.557979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] MFA Rules not processed for user `4adb750355c1415983020568ab52314d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:23.559307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:23.626821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1361/2743] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:23.631523 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.699495 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc954-28ab-4341-9c98-01d8bffdc277 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.704155 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.704823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.705105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.705368 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.706002 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.708503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.800954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1383/2744] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:23 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:23.805133 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.815737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01eb65e-d676-4559-800d-32ff7225ff9c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.872259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.872867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.873146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:23.873416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:23.874040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:23.875944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:23.981448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1362/2745] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:23 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:23.986377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:23.994149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376254-b019-4c85-b67a-1da11eb4f8e1 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:23.998867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:23.999461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:23.999739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.000036 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.000664 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:24.002234 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:24.015215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1384/2746] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:24.020153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:24.030064 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706520-8715-4816-a2e7-00e2ab94c1dd admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:24.034664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:24.039908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:24.039908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.039908 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] PATH_INFO: `/v3/projects/6804c58764f94f649393cb647cfe8aae/users/93c120c88c85479ea9a0ab35f00ad779/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.050309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6804c58764f94f649393cb647cfe8aae, user_id=93c120c88c85479ea9a0ab35f00ad779, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:24.053657 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:24.148007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1363/2747] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:24 2022] PUT /identity/v3/projects/6804c58764f94f649393cb647cfe8aae/users/93c120c88c85479ea9a0ab35f00ad779/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:24.152149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:24.162346 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6eb4e-783c-4888-805d-ba0fb56bc351 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:24.195416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:24.218943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:24.219545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:24.219820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.220131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.220775 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:24.222468 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a2df-075a-4e94-8ef2-b26b63184d45 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:24.232490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1385/2748] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:24.236801 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:24.247690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b490b06-347f-4b55-8a4a-69cc875cd79d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:24.252839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:24.253541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:24.254424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.254800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] PATH_INFO: `/v3/projects/6804c58764f94f649393cb647cfe8aae/users/93c120c88c85479ea9a0ab35f00ad779/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.257036 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6804c58764f94f649393cb647cfe8aae, user_id=93c120c88c85479ea9a0ab35f00ad779, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:24.260285 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:24.270109 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1364/2749] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:24 2022] PUT /identity/v3/projects/6804c58764f94f649393cb647cfe8aae/users/93c120c88c85479ea9a0ab35f00ad779/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:24.281068 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:24.281352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.281622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.310244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] MFA Rules not processed for user `93c120c88c85479ea9a0ab35f00ad779`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:24.311548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:24.379227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1386/2750] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:24.390507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:24.392297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:24.438357 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:24.450690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa4e6-f49f-4e16-8987-f6c58ab369ac admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:24.454356 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:24.459799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:24.459799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:24.459799 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:24.511861 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:24.513330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca9781-100a-4e13-b1ad-759d374da94c service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:24.522314 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1365/2751] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:25.644408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:25.645834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:25.710464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91660e-9e76-4434-90ef-440e79eea2f9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:25.714897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:25.715512 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:25.716235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:25.716235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] PATH_INFO: `/v3/users/c94f0df3304444378b949787143e1817` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:25.717204 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94f0df3304444378b949787143e1817)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:25.719093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:25.878206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94f0df3304444378b949787143e1817'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:25.886655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:25.891064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94f0df3304444378b949787143e1817'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:25.897742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94f0df3304444378b949787143e1817'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:25.970994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94f0df3304444378b949787143e1817'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:25.971616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94f0df3304444378b949787143e1817'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:25.978884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1387/2752] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:25 2022] DELETE /identity/v3/users/c94f0df3304444378b949787143e1817 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:25.983391 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:25.994164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:25.994164 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:26.003642 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:26.005466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:26.064541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1366/2753] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:26.074954 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:26.076416 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:26.133261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2a74c-7880-453b-9822-c2ffa78faf4c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:26.136862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:26.137463 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:26.137745 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:26.138022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:26.147163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:26.148667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:26.157997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1388/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:26.479526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:26.480911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:26.539626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79839fd4-7016-4b7b-bfd9-7da4fb8485e5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:26.543126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:26.543724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:26.544028 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:26.544328 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:26.546048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:26.594171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=100 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:26.606915 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:26.608650 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:26.608805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:26.610256 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:26.619732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1367/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:26.628288 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8196ba-9492-4a83-8510-63a2a9e3abe7 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:26.634879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:26.635585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:26.636004 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:26.636177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] PATH_INFO: `/v3/projects/b38b2e526c234a2f9dd0b96ccf478be6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:26.637434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38b2e526c234a2f9dd0b96ccf478be6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:26.639354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:26.748615 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38b2e526c234a2f9dd0b96ccf478be6', 'request_id': 'req-2cc53bba-a762-4722-b33a-1518fc643e84'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:26.755298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38b2e526c234a2f9dd0b96ccf478be6', 'request_id': 'req-2cc53bba-a762-4722-b33a-1518fc643e84'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:26.760977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38b2e526c234a2f9dd0b96ccf478be6', 'request_id': 'req-2cc53bba-a762-4722-b33a-1518fc643e84'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:26.828804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] The token cache is being invalidate because project b38b2e526c234a2f9dd0b96ccf478be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:26.829092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:26.829705 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:26.831203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1389/2756] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:26 2022] DELETE /identity/v3/projects/b38b2e526c234a2f9dd0b96ccf478be6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:26.835380 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:26.846161 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643d8b-c672-4add-b328-10ba69d98b40 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:26.913978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:26.917812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:26.917812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:26.917812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] PATH_INFO: `/v3/users/0a785381d9844955b35c9ca4f06a6f53` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:26.917812 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a785381d9844955b35c9ca4f06a6f53)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:26.920525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:27.072672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a785381d9844955b35c9ca4f06a6f53'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.085281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a785381d9844955b35c9ca4f06a6f53'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.092272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a785381d9844955b35c9ca4f06a6f53'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.092972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a785381d9844955b35c9ca4f06a6f53'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.178358 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ff05ead1-b7a8-44a9-aab9-131607905c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a785381d9844955b35c9ca4f06a6f53'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.185001 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1368/2757] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:26 2022] DELETE /identity/v3/users/0a785381d9844955b35c9ca4f06a6f53 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:27.620140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:27.621556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:27.635382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc53bba-a762-4722-b33a-1518fc643e84 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:27.693748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:27.694307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:27.694630 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:27.694886 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] PATH_INFO: `/v3/projects/2fae15c1e272465c893303104deee37a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:27.696441 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fae15c1e272465c893303104deee37a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:27.698322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:27.700642 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:27.824419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fae15c1e272465c893303104deee37a', 'request_id': 'req-a4b827e2-8603-4b5f-92f9-ae4f1744a411'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.830830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fae15c1e272465c893303104deee37a', 'request_id': 'req-a4b827e2-8603-4b5f-92f9-ae4f1744a411'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.838567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fae15c1e272465c893303104deee37a', 'request_id': 'req-a4b827e2-8603-4b5f-92f9-ae4f1744a411'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.920211 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] The token cache is being invalidate because project 2fae15c1e272465c893303104deee37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:27.920501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.921131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:27.922900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1390/2758] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:27 2022] DELETE /identity/v3/projects/2fae15c1e272465c893303104deee37a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:27.927660 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec63-1823-45f6-91ce-cd408ea5c3ed None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:27.927951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec63-1823-45f6-91ce-cd408ea5c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:27.928269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cec63-1823-45f6-91ce-cd408ea5c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:27.949351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0b4cec63-1823-45f6-91ce-cd408ea5c3ed None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:27.950549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0b4cec63-1823-45f6-91ce-cd408ea5c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:28.011208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1369/2759] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:28.014755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.016151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:28.018970 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff608-0852-4588-b961-4006ab124c47 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.019854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff608-0852-4588-b961-4006ab124c47 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.020272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff608-0852-4588-b961-4006ab124c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.040140 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-530ff608-0852-4588-b961-4006ab124c47 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:28.041396 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-530ff608-0852-4588-b961-4006ab124c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:28.049326 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1370/2760] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:28.053558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff608-0852-4588-b961-4006ab124c47 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.059206 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:28.063016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff608-0852-4588-b961-4006ab124c47 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.067627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.068246 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.074783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.074783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.074783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:28.074783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.074783 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.075686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b827e2-8603-4b5f-92f9-ae4f1744a411 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.078923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.079540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.079837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.080149 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.082370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:28.083909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1371/2761] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:17:28.088101 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.098820 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5089-d11b-4de5-841b-358245098694 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.104678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.104678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.104678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.104678 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.105148 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.106999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.150263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.151663 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.161695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1391/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:28.192069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1372/2763] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:28.196255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.206379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7a53e-b49a-4397-8b15-95d97fde90f6 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.248213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:28.269137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.270339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.270625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.270888 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.271552 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.273496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.389481 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1392/2764] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:28.390664 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.402268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb8cd-4e21-4f00-ae2e-15c4cb6dece0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.406839 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.407453 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.407719 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.408017 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.408701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.410481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.428677 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1373/2765] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:28.429830 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.440434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf227c-c73c-4934-9b64-1e1306cf73fe admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.446137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.446920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.447501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.447772 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.448492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.450064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09119d-8477-4c25-b262-e0f2785db353 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.460639 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1393/2766] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:17:28.464708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.474652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e8ab-3da9-4592-8864-b68d1888e55e admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.479188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.479833 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.480142 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.480422 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] PATH_INFO: `/v3/projects/efb55218b23e45ed861a47faae5c0074/users/32cb58dec0344652b7dd381387856936/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.495175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb55218b23e45ed861a47faae5c0074, user_id=32cb58dec0344652b7dd381387856936, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.497971 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.549566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1374/2767] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:28 2022] PUT /identity/v3/projects/efb55218b23e45ed861a47faae5c0074/users/32cb58dec0344652b7dd381387856936/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:28.568019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.568352 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.568654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.596453 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] MFA Rules not processed for user `32cb58dec0344652b7dd381387856936`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:28.597706 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:28.663398 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1394/2768] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:28.668156 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.730481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8430a-da88-4b55-b16e-ea5a498cc594 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.735116 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.735721 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.736025 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.736307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.736929 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.739605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.818889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1375/2769] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:28.822977 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.833686 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc322a4-0351-4ddc-ba95-ee5ac0548f08 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.894650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.895261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.895545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.895936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.896667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:28.898782 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:28.977292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1395/2770] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:28 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:28.981523 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:28.992533 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bb7e8-7520-47c7-8ce0-479cf9d914e5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:28.997469 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:28.998121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:28.998405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:28.998684 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:28.999327 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.001015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.011511 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1376/2771] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:29.015716 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:29.025723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa6737-b4e3-4e58-b468-71ea0b209755 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:29.030299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:29.030940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.031216 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.031491 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] PATH_INFO: `/v3/projects/1ef065dd85ef44af892ef699ed9e956d/users/c480e3770a1e49fe950e49a557b84602/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.046673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef065dd85ef44af892ef699ed9e956d, user_id=c480e3770a1e49fe950e49a557b84602, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.049303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.120982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1396/2772] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:29 2022] PUT /identity/v3/projects/1ef065dd85ef44af892ef699ed9e956d/users/c480e3770a1e49fe950e49a557b84602/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:29.125135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:29.135743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df2eb-faa8-4c15-8c29-3f56c3ab2ae3 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:29.191002 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:29.191627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.191899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.192196 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.192825 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.194427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c727e-f59f-4006-8c82-5a30ef93e99e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.204182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1377/2773] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:29.208628 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:29.219633 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab28741-29bb-4ebc-9f1a-f789ab255681 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:29.224861 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:29.227127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.227127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.227127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] PATH_INFO: `/v3/projects/1ef065dd85ef44af892ef699ed9e956d/users/c480e3770a1e49fe950e49a557b84602/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.227970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef065dd85ef44af892ef699ed9e956d, user_id=c480e3770a1e49fe950e49a557b84602, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.230662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.242260 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1397/2774] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:29 2022] PUT /identity/v3/projects/1ef065dd85ef44af892ef699ed9e956d/users/c480e3770a1e49fe950e49a557b84602/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:29.252542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.252895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.253179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.261844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:29.282185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] MFA Rules not processed for user `c480e3770a1e49fe950e49a557b84602`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:29.284854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:29.353132 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1378/2775] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:29.364556 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:29.369179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:29.419890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa63c9-a58c-4aa0-9ebe-b788d4f0915f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:29.423601 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:29.424236 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.424515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.424786 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.434534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.436169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.445697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1398/2776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:29.635898 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:29.645889 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f319f1-7c57-4a99-8557-edd12a50b8ec None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:29.649483 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:29.650091 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:29.650330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:29.650604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:29.706796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:29.708900 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c39e1d-4413-43c7-af52-a4bc60415a67 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:29.717536 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1379/2777] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:32.831069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:32.832504 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:32.895535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa032-e2b2-4d2c-90ef-d033b292c38a service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:32.900138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:32.900769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:32.901050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:32.901321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] PATH_INFO: `/v3/users/a28631eb4c484c1a9e148f1f34367686` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:32.902464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28631eb4c484c1a9e148f1f34367686)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:32.904548 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:33.089872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28631eb4c484c1a9e148f1f34367686'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:33.103219 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28631eb4c484c1a9e148f1f34367686'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:33.110281 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28631eb4c484c1a9e148f1f34367686'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:33.160464 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28631eb4c484c1a9e148f1f34367686'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:33.161091 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28631eb4c484c1a9e148f1f34367686'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:33.168159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1399/2778] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:32 2022] DELETE /identity/v3/users/a28631eb4c484c1a9e148f1f34367686 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:33.172790 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:33.173268 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:33.178732 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:33.192508 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:33.193763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:33.254673 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1380/2779] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:33.264874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:33.270641 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:33.294712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:33.325833 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405a88f-1dde-4b31-bc6e-041f69b4e4f1 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:33.329838 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:33.330391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:33.330676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:33.330994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:33.341199 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:33.342624 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:33.352574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1400/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:33.785135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:33.786709 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:33.801316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e46a1a-35c1-48ba-a27e-fcde8aec9adf None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:33.808389 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:33.809183 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:33.809525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:33.809928 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] PATH_INFO: `/v3/projects/5edddb876d5b42869f189a0ed6ad6036` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:33.811321 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edddb876d5b42869f189a0ed6ad6036)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:33.813288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:33.838785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:33.938335 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edddb876d5b42869f189a0ed6ad6036', 'request_id': 'req-b1c7b418-bb70-4338-a457-c07134467572'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.033616 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edddb876d5b42869f189a0ed6ad6036', 'request_id': 'req-b1c7b418-bb70-4338-a457-c07134467572'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.040953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edddb876d5b42869f189a0ed6ad6036', 'request_id': 'req-b1c7b418-bb70-4338-a457-c07134467572'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.051307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] The token cache is being invalidate because project 5edddb876d5b42869f189a0ed6ad6036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:34.051595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.052803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.054514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1381/2781] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:33 2022] DELETE /identity/v3/projects/5edddb876d5b42869f189a0ed6ad6036 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:34.059197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:34.070198 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256388d3-ecf4-485e-81e1-75e9feb6a488 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:34.125940 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:34.126497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:34.126778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:34.127050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] PATH_INFO: `/v3/users/4adb750355c1415983020568ab52314d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:34.128190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adb750355c1415983020568ab52314d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:34.130094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:34.293760 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adb750355c1415983020568ab52314d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.306301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adb750355c1415983020568ab52314d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.313428 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adb750355c1415983020568ab52314d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.360767 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adb750355c1415983020568ab52314d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.361372 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adb750355c1415983020568ab52314d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:34.368257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1401/2782] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:34 2022] DELETE /identity/v3/users/4adb750355c1415983020568ab52314d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:34.757496 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:34.759022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:34.772873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b418-bb70-4338-a457-c07134467572 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:34.831875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:34.832540 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:34.832827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:34.833087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] PATH_INFO: `/v3/projects/04e6bbb9f2b04bdb9bbd8db911daa808` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:34.834242 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e6bbb9f2b04bdb9bbd8db911daa808)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:34.836141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:34.966570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e6bbb9f2b04bdb9bbd8db911daa808', 'request_id': 'req-bb2bbb4f-d6ac-4867-a987-da24701624ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.040710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e6bbb9f2b04bdb9bbd8db911daa808', 'request_id': 'req-bb2bbb4f-d6ac-4867-a987-da24701624ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.047455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e6bbb9f2b04bdb9bbd8db911daa808', 'request_id': 'req-bb2bbb4f-d6ac-4867-a987-da24701624ef'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.058045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] The token cache is being invalidate because project 04e6bbb9f2b04bdb9bbd8db911daa808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:35.058360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.058985 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.060506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1382/2783] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:34 2022] DELETE /identity/v3/projects/04e6bbb9f2b04bdb9bbd8db911daa808 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:35.064606 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:35.065982 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:35.079012 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbaaa5-b2d8-45b6-8b24-fcb138516b53 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:35.125308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:35.138420 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:35.141917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:35.141917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:35.141917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] PATH_INFO: `/v3/users/93c120c88c85479ea9a0ab35f00ad779` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:35.141917 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c120c88c85479ea9a0ab35f00ad779)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:35.143087 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:35.398461 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c120c88c85479ea9a0ab35f00ad779'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.413017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c120c88c85479ea9a0ab35f00ad779'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.420732 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c120c88c85479ea9a0ab35f00ad779'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.469475 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c120c88c85479ea9a0ab35f00ad779'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.470128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-abdf9ce3-ef12-4b89-8b45-19d4b1847120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c120c88c85479ea9a0ab35f00ad779'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:35.476698 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1402/2784] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:35 2022] DELETE /identity/v3/users/93c120c88c85479ea9a0ab35f00ad779 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:35.886767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:35.888416 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:35.901708 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bbb4f-d6ac-4867-a987-da24701624ef admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:35.945345 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:35.961325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:35.961959 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:35.962267 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:35.962569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] PATH_INFO: `/v3/projects/6804c58764f94f649393cb647cfe8aae` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:35.963680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6804c58764f94f649393cb647cfe8aae)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:35.965598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.092311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6804c58764f94f649393cb647cfe8aae', 'request_id': 'req-4d17f58b-a947-4d77-aedf-daec3ef0dea6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:36.200765 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6804c58764f94f649393cb647cfe8aae', 'request_id': 'req-4d17f58b-a947-4d77-aedf-daec3ef0dea6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:36.207241 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6804c58764f94f649393cb647cfe8aae', 'request_id': 'req-4d17f58b-a947-4d77-aedf-daec3ef0dea6'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:36.218010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] The token cache is being invalidate because project 6804c58764f94f649393cb647cfe8aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:36.218297 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:36.218919 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d17f58b-a947-4d77-aedf-daec3ef0dea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:36.220466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1383/2785] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:35 2022] DELETE /identity/v3/projects/6804c58764f94f649393cb647cfe8aae => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:36.225911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.226438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.226438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.246151 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:36.247345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:36.306240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1403/2786] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:36.313882 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.314168 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.314438 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.334316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:36.336057 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:36.343859 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1384/2787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:36.347969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.358259 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71baf0a-8465-4466-b459-b5413e194dad None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.362818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.363412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.363688 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.363957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.364617 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:36.365000 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.366768 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.377955 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1404/2788] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:17:36.382821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.392073 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8916c-69b8-4080-9ef1-1d290949be5e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.397481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.398067 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.398341 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.398614 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.399244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.401170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.491853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1385/2789] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:36 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:36.495966 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.506500 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061be8f1-7c97-4d75-b682-128a5568444c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.555247 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:36.564460 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.565066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.565345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.570365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.570365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.570365 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.675580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1405/2790] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:36 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:36.683269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.694406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b789d6-7d3b-4654-8c3b-bee7c2cba57d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.699163 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.699767 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.702352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.702352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.702352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.702656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.714666 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1386/2791] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:36.718594 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.729430 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac074b-2beb-44c7-ba42-101abec69bff admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.734310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.734935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.735212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.735484 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.736169 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.737805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169beabe-8e4f-40e3-a275-2592e0bf0922 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.754472 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1406/2792] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:36.754632 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:36.764292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949eabe-bb41-4462-8902-07a69c750f83 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:36.768786 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:36.769427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.769702 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.769968 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] PATH_INFO: `/v3/projects/c6abbfea438d456d8b6b4fca7c446784/users/e817ffbfe6774f35b24893b6e54b54c3/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.789621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6abbfea438d456d8b6b4fca7c446784, user_id=e817ffbfe6774f35b24893b6e54b54c3, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:36.792281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:36.890884 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1387/2793] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:36 2022] PUT /identity/v3/projects/c6abbfea438d456d8b6b4fca7c446784/users/e817ffbfe6774f35b24893b6e54b54c3/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:36.905174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:36.905174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:36.905174 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:36.933581 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] MFA Rules not processed for user `e817ffbfe6774f35b24893b6e54b54c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:36.934806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:37.002329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1407/2794] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:37.006831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.067699 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7464ee-4cea-45b1-b207-2be482afc3ff admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.072558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.073153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.073431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.073701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.074329 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.076394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.090895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:37.215465 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1388/2795] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:37 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:37.219589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.276661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d374751-914a-4d66-b519-98788cbe0cdc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.332994 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.333597 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.333873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.334142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.335473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.337593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.447385 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1408/2796] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:37 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:37.451379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.497111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c517809-adae-40da-bfbf-e26ed2cf56ce admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.502015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.502624 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.502906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.503185 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.503873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.507559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.516350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1389/2797] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:17:37.520514 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.525654 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:37.530916 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46194b-0c16-4131-9d8b-46c713684c42 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.535337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.535927 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.536233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.536502 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.537127 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.538930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51401d5c-a74b-4c5a-8311-67327291a1d7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.550050 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1409/2798] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:37.553737 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.563865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741246e-8d0e-42f4-9c08-bd8a08730c9d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.568574 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.569804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.570068 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.570343 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] PATH_INFO: `/v3/projects/52918b05a332446dab7801365b38e13a/users/1a3c2ba824294984a25db56d6beb642d/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.586726 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52918b05a332446dab7801365b38e13a, user_id=1a3c2ba824294984a25db56d6beb642d, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.589455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.670316 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1390/2799] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:37 2022] PUT /identity/v3/projects/52918b05a332446dab7801365b38e13a/users/1a3c2ba824294984a25db56d6beb642d/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:37.685148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.685427 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.685703 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.713496 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] MFA Rules not processed for user `1a3c2ba824294984a25db56d6beb642d`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:37.714819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:37.780448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1410/2800] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:37.785150 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.847955 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e042b-69a0-4c73-93e1-44d4a6ac0045 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:37.853087 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:37.853687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:37.853962 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:37.854232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:37.854865 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:37.856829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:37.980092 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1391/2801] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:37 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:37.984217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:37.996419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f786f-9b1b-44d3-b339-2f4acd91e6d4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.056899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.056899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.056899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.056899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.057413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.057509 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.154026 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1411/2802] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:37 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:38.157944 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.169319 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3df0-8379-43af-9d2d-a30512beab00 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.173952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.175478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.175478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.175478 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.175770 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.177292 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.188710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1392/2803] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:38.193104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.203596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d2e-eb2b-4408-88cb-9a9f1f198792 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.208176 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.208882 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.209163 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.210089 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] PATH_INFO: `/v3/projects/e3700fb11fb7459d89b0072d314d893c/users/2939ab3e703b473989737afc98255846/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.224808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3700fb11fb7459d89b0072d314d893c, user_id=2939ab3e703b473989737afc98255846, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.228585 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.301643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.303351 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.316160 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1412/2804] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:38 2022] PUT /identity/v3/projects/e3700fb11fb7459d89b0072d314d893c/users/2939ab3e703b473989737afc98255846/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:38.316674 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30757756-a271-4335-a47b-2ec5182d100b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.320338 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.363467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:38.371080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:38.376079 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.376715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.376996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.377269 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] PATH_INFO: `/v3/users/32cb58dec0344652b7dd381387856936` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.378401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32cb58dec0344652b7dd381387856936)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.380344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.385423 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc823-e924-4ca4-a57f-c11ffc3a01a3 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.390057 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.390667 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.390949 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.391226 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.391876 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.393535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.404197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1413/2805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:38.408379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.418867 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b69fd1-773c-4666-bc97-0e585582a5ea admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.423743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.424748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.425080 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.425354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] PATH_INFO: `/v3/projects/e3700fb11fb7459d89b0072d314d893c/users/2939ab3e703b473989737afc98255846/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.427257 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3700fb11fb7459d89b0072d314d893c, user_id=2939ab3e703b473989737afc98255846, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.430022 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b94df3-e140-40b3-97d4-81de328630ff admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.440272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1414/2806] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:38 2022] PUT /identity/v3/projects/e3700fb11fb7459d89b0072d314d893c/users/2939ab3e703b473989737afc98255846/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:38.450213 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.450499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.450777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.479010 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] MFA Rules not processed for user `2939ab3e703b473989737afc98255846`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:38.480283 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.546242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1415/2807] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:38.558178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.559551 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.564306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32cb58dec0344652b7dd381387856936'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:38.576829 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32cb58dec0344652b7dd381387856936'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:38.583531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32cb58dec0344652b7dd381387856936'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:38.584244 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32cb58dec0344652b7dd381387856936'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:38.633280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838490be-e8ca-44aa-9940-da53b711fbfe None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.636887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.637485 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.637762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.638034 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.639890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.640759 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6d4dac24-3eb5-4a9c-8997-49b53fee9ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32cb58dec0344652b7dd381387856936'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:38.648809 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1393/2808] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:38 2022] DELETE /identity/v3/users/32cb58dec0344652b7dd381387856936 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:38.653214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.653507 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.656895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.682089 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:38.683304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.696403 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:38.699691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.701159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.710818 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1416/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:38.742828 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1394/2810] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:38.752661 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:38.754650 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:38.823300 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4f47-1149-4655-93f2-a1260dddfe5f service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:38.877133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:38.877762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:38.878039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:38.878309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:38.887742 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:38.889193 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:38.898612 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1417/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:39.362803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:39.364371 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:39.382918 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6237af-13bd-4a5e-a727-ac8fc56e182c None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:39.388381 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:39.389074 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:39.391421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:39.391421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] PATH_INFO: `/v3/projects/efb55218b23e45ed861a47faae5c0074` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:39.391421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb55218b23e45ed861a47faae5c0074)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:39.392800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:39.514474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb55218b23e45ed861a47faae5c0074', 'request_id': 'req-dea66632-92f1-4ec2-845d-915172d9ef92'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.593311 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb55218b23e45ed861a47faae5c0074', 'request_id': 'req-dea66632-92f1-4ec2-845d-915172d9ef92'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.594653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:39.600475 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb55218b23e45ed861a47faae5c0074', 'request_id': 'req-dea66632-92f1-4ec2-845d-915172d9ef92'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.611083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] The token cache is being invalidate because project efb55218b23e45ed861a47faae5c0074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:39.611427 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.612082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.613549 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1395/2812] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:39 2022] DELETE /identity/v3/projects/efb55218b23e45ed861a47faae5c0074 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:39.617719 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:39.629426 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339ea0-909a-4db1-accb-cc4a8dbe003d service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:39.682816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:39.683447 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:39.683723 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:39.684018 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] PATH_INFO: `/v3/users/c480e3770a1e49fe950e49a557b84602` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:39.685244 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c480e3770a1e49fe950e49a557b84602)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:39.687210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:39.854690 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c480e3770a1e49fe950e49a557b84602'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.859939 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:39.867543 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c480e3770a1e49fe950e49a557b84602'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.874298 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c480e3770a1e49fe950e49a557b84602'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.955209 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c480e3770a1e49fe950e49a557b84602'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.955789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-621296d5-58d7-4884-8bc3-8473853985be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c480e3770a1e49fe950e49a557b84602'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:39.962221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1418/2813] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:39 2022] DELETE /identity/v3/users/c480e3770a1e49fe950e49a557b84602 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:40.360815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:40.364032 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:40.380102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66632-92f1-4ec2-845d-915172d9ef92 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:40.444310 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:40.444951 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.445233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.445529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] PATH_INFO: `/v3/projects/1ef065dd85ef44af892ef699ed9e956d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.446938 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef065dd85ef44af892ef699ed9e956d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:40.448858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:40.561307 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef065dd85ef44af892ef699ed9e956d', 'request_id': 'req-a985e262-795a-4775-84c7-cb7ddd324694'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:40.641078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef065dd85ef44af892ef699ed9e956d', 'request_id': 'req-a985e262-795a-4775-84c7-cb7ddd324694'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:40.648996 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef065dd85ef44af892ef699ed9e956d', 'request_id': 'req-a985e262-795a-4775-84c7-cb7ddd324694'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:40.661448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] The token cache is being invalidate because project 1ef065dd85ef44af892ef699ed9e956d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:40.661763 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:40.662516 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:40.664930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1396/2814] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:40 2022] DELETE /identity/v3/projects/1ef065dd85ef44af892ef699ed9e956d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:40.669625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68b4f-35c3-4cc6-abb7-9649acf9eb87 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.670103 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68b4f-35c3-4cc6-abb7-9649acf9eb87 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.670217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68b4f-35c3-4cc6-abb7-9649acf9eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.691123 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:40.692545 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:40.725272 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3cf68b4f-35c3-4cc6-abb7-9649acf9eb87 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:40.726489 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3cf68b4f-35c3-4cc6-abb7-9649acf9eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:40.751045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e262-795a-4775-84c7-cb7ddd324694 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:40.754811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:40.755466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.755743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.756806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.758854 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:40.791440 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1419/2815] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:40.794231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:40.800503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.800793 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.801070 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.821820 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:40.822952 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:40.828236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:40.830259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:40.830935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1420/2816] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:40.835064 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:40.840016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1397/2817] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:40.844835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6d3b-4cc8-46d0-9a65-9386f7bc6d42 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:40.849522 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:40.850704 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.850943 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.851215 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.851879 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:40.852214 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:40.853792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:40.866318 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1421/2818] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 08:17:40.870796 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:40.881366 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680e53-9fcb-4213-b2bd-5c68d4f50266 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:40.885934 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:40.886525 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:40.886800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:40.887070 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:40.887687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:40.889584 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.024062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1398/2819] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:40 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:41.028380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.038415 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb3e6-e857-4350-8e52-cb95712a38cd admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.094065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.094583 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.094858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.095128 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.095754 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.097670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.246482 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1422/2820] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:41 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:41.250787 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.261658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd34f30-2f2e-4907-ad0b-5d3b633a367b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.266344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.266999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.267273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.267541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.268216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.269793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.281611 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1399/2821] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:41.286197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.297326 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a5ea-f410-4718-96c9-c72162a29929 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.302097 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.302695 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.302969 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.303894 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.304576 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.306150 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fc735-0a17-4a07-96f0-e434f3e4a6ae admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.317459 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1423/2822] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 08:17:41.322826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.333406 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac2a85-6527-40f3-af01-7cf76196acba admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.338717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.338717 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.339031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.339309 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] PATH_INFO: `/v3/projects/5d544de71c1f4334b5849b58a4ab63ab/users/6e6cdacf29d84727bc7d03e3c34866ea/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.354078 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d544de71c1f4334b5849b58a4ab63ab, user_id=6e6cdacf29d84727bc7d03e3c34866ea, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.356776 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.468554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1400/2823] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:41 2022] PUT /identity/v3/projects/5d544de71c1f4334b5849b58a4ab63ab/users/6e6cdacf29d84727bc7d03e3c34866ea/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:41.479242 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.479560 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.479835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.493362 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:41.509992 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] MFA Rules not processed for user `6e6cdacf29d84727bc7d03e3c34866ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:41.511210 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:41.575863 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1424/2824] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:41.580379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.649312 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5932c-dcf6-4d2a-a11e-79b8c0294e4a admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.656235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.656972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.657306 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.657620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.658392 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.660652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.754851 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1401/2825] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:41 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:41.765316 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.777233 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8558a-df25-48fd-b1b2-61a6a3ad493a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.833391 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.833997 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.834871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.835138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.835868 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.837854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.927631 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1425/2826] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:41 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:41.934139 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.947568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d710-f1bf-4dc9-a85f-a752c902dfd1 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.952672 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.953180 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.953374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.953648 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:41.954298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:41.955954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:41.967623 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1402/2827] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:41.971858 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:41.981893 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad8d6e-67f1-49c2-b3b8-d1043c5464b2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:41.986499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:41.987130 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:41.987409 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:41.987717 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] PATH_INFO: `/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57/users/684990a23bfc4f9982e6c4c273c8cd97/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.003138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e95ab1a6e348bd8310e4212bdd1c57, user_id=684990a23bfc4f9982e6c4c273c8cd97, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:42.005822 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:42.081162 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1426/2828] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:41 2022] PUT /identity/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57/users/684990a23bfc4f9982e6c4c273c8cd97/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:42.085582 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:42.095910 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c419375-76c2-4f1f-a5c1-0bd4249958b0 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:42.140784 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:42.153566 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:42.154200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:42.154481 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:42.154758 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.155395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:42.157147 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6461e5-8162-432e-8828-e264c8a27608 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:42.166943 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1403/2829] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:42.171333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:42.182691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901920-a5d7-404c-9626-ae7a1555138a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:42.187696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:42.188390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:42.188672 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:42.189271 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] PATH_INFO: `/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57/users/684990a23bfc4f9982e6c4c273c8cd97/roles/a902366353714eaeb9753ac3ce606c58` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.190873 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e95ab1a6e348bd8310e4212bdd1c57, user_id=684990a23bfc4f9982e6c4c273c8cd97, role_id=a902366353714eaeb9753ac3ce606c58)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:42.193843 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:42.205157 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1427/2830] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:42 2022] PUT /identity/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57/users/684990a23bfc4f9982e6c4c273c8cd97/roles/a902366353714eaeb9753ac3ce606c58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:42.216940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:42.217233 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:42.217543 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.262486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] MFA Rules not processed for user `684990a23bfc4f9982e6c4c273c8cd97`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:42.263705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:42.326542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:42.335553 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1404/2831] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:42.347749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:42.349131 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:42.378751 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:42.383866 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e937-9281-4b0b-821e-5f8173e42f95 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:42.387890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:42.390806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:42.390806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:42.390806 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.391102 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:42.406890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44639-6e31-4309-af1e-3b0df401b909 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:42.410561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:42.411454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:42.411736 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:42.412031 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:42.422007 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:42.423450 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:42.434179 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1405/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:42.457677 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:42.459165 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc343434-7b55-4977-95ba-cfd50007222f service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:42.468870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1428/2833] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:17:43.331295 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:43.392625 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76accf4-1778-4811-b1e9-ce282aa543e6 service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:43.397117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:43.397738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:43.398020 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:43.398296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] PATH_INFO: `/v3/users/6e6cdacf29d84727bc7d03e3c34866ea` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:43.399399 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6cdacf29d84727bc7d03e3c34866ea)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:43.401941 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:43.414417 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:43.563629 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6cdacf29d84727bc7d03e3c34866ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:43.576253 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6cdacf29d84727bc7d03e3c34866ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:43.582999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6cdacf29d84727bc7d03e3c34866ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:43.583682 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6cdacf29d84727bc7d03e3c34866ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:43.650710 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6cdacf29d84727bc7d03e3c34866ea'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:43.657013 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1406/2834] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:43 2022] DELETE /identity/v3/users/6e6cdacf29d84727bc7d03e3c34866ea => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:43.661592 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:43.662062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:43.662161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:43.681141 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:43.683206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:43.742555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1429/2835] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:43.754165 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:43.755718 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:43.816890 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd3562-3d0c-4f5b-ada0-c94262705a22 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:43.820509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:43.821114 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:43.821393 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:43.821690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:43.831886 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:43.833352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:43.844102 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1407/2836] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:44.300666 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:44.302337 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:44.316840 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d6858-7ffb-4720-92bd-a78af4b9343e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:44.323083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:44.323734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:44.324069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:44.330190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] PATH_INFO: `/v3/projects/5d544de71c1f4334b5849b58a4ab63ab` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:44.330190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d544de71c1f4334b5849b58a4ab63ab)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:44.330190 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:44.453295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d544de71c1f4334b5849b58a4ab63ab', 'request_id': 'req-c423544a-20aa-4597-9535-9074ae119469'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.459535 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d544de71c1f4334b5849b58a4ab63ab', 'request_id': 'req-c423544a-20aa-4597-9535-9074ae119469'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.465655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d544de71c1f4334b5849b58a4ab63ab', 'request_id': 'req-c423544a-20aa-4597-9535-9074ae119469'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.537492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] The token cache is being invalidate because project 5d544de71c1f4334b5849b58a4ab63ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:44.537783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.538454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.539932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1430/2837] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:44 2022] DELETE /identity/v3/projects/5d544de71c1f4334b5849b58a4ab63ab => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:44.544862 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:44.554654 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397270-69d7-49ab-a55c-18c22b54f2a1 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:44.612365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:44.612911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:44.613187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:44.613454 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] PATH_INFO: `/v3/users/684990a23bfc4f9982e6c4c273c8cd97` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:44.614806 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684990a23bfc4f9982e6c4c273c8cd97)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:44.616756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:44.804038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:44.814085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684990a23bfc4f9982e6c4c273c8cd97'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.825597 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684990a23bfc4f9982e6c4c273c8cd97'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.832395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684990a23bfc4f9982e6c4c273c8cd97'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.833062 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684990a23bfc4f9982e6c4c273c8cd97'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.896193 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-76c93c14-98d3-4b2f-9062-7ee9e580cb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684990a23bfc4f9982e6c4c273c8cd97'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:44.902926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1408/2838] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:44 2022] DELETE /identity/v3/users/684990a23bfc4f9982e6c4c273c8cd97 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:45.316668 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:45.322161 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:45.333580 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423544a-20aa-4597-9535-9074ae119469 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:45.357159 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:45.397710 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:45.398348 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.398625 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.398895 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] PATH_INFO: `/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.400094 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e95ab1a6e348bd8310e4212bdd1c57)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:45.401984 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:45.495578 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e95ab1a6e348bd8310e4212bdd1c57', 'request_id': 'req-62fe076b-f91b-4e6f-9ebf-26fa16b96785'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:45.502142 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e95ab1a6e348bd8310e4212bdd1c57', 'request_id': 'req-62fe076b-f91b-4e6f-9ebf-26fa16b96785'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:45.507856 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e95ab1a6e348bd8310e4212bdd1c57', 'request_id': 'req-62fe076b-f91b-4e6f-9ebf-26fa16b96785'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:45.566559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] The token cache is being invalidate because project b8e95ab1a6e348bd8310e4212bdd1c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:45.566854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:45.567558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-62fe076b-f91b-4e6f-9ebf-26fa16b96785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:45.573404 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1431/2839] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:45 2022] DELETE /identity/v3/projects/b8e95ab1a6e348bd8310e4212bdd1c57 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:45.576906 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.577365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.577491 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.599121 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:45.600405 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:45.662793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1409/2840] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:45.672353 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.672645 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.672925 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.693117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:45.694325 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:45.702433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1432/2841] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:45.706667 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:45.717052 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7803a5a-c36e-4143-96be-1f0d4833dc3e None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:45.721844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:45.722472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.722753 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.723022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.723688 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:45.724014 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:45.725595 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:45.738214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1410/2842] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:17:45.742619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:45.752287 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97eee-4f53-40b2-8b65-cd70aafc3b3f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:45.757053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:45.757646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.757922 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.758186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.758812 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:45.760777 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:45.847923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1433/2843] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:45.852186 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:45.862803 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b766-2f40-49d7-a3b7-0759098b4c5b admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:45.919579 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:45.920170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:45.920451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:45.920724 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:45.921349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:45.923289 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:46.006874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1411/2844] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:45 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:46.011826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:46.022179 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb705c7-cfb1-49be-8bc3-a0a7de206359 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:46.026978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:46.036872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:46.036872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:46.036872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:46.036872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:46.036872 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:46.040357 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1434/2845] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:46.044926 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:46.055188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689add-8a9f-4169-b9e7-ce341310fc7d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:46.060838 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:46.061494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:46.061816 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:46.062090 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:46.062847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:46.064635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee94a97-aa05-4ed1-920c-e7d02728963a admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:46.076338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1412/2846] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:46.080555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:46.091131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc07bd-8e33-47ea-9bd7-4380b31b48fb admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:46.095870 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:46.096558 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:46.096835 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:46.100093 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] PATH_INFO: `/v3/projects/d0f2c5c728cf48d78069c7e4f3600bcc/users/8e73d05272624502aa2a664cbe01e76f/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:46.112696 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f2c5c728cf48d78069c7e4f3600bcc, user_id=8e73d05272624502aa2a664cbe01e76f, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:46.115335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:46.230471 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1435/2847] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:46 2022] PUT /identity/v3/projects/d0f2c5c728cf48d78069c7e4f3600bcc/users/8e73d05272624502aa2a664cbe01e76f/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:46.240842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:46.241201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:46.241506 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:46.269871 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] MFA Rules not processed for user `8e73d05272624502aa2a664cbe01e76f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:46.271083 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:46.276434 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:46.337892 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1413/2848] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:46.349431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:46.351126 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:46.405841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:46.409529 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f9f-a067-475e-8d9a-1f30c9089e7d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:46.413270 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:46.413885 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:46.416540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:46.416540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:46.424295 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:46.425739 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfa091-da53-47cc-a400-12e65c7e92cf service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:46.435262 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1436/2849] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:47.076437 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:47.077905 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:47.153670 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc54b14-fcb6-4f67-8342-4e8a1be6f334 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:47.158216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:47.158846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:47.159127 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:47.159402 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] PATH_INFO: `/v3/users/e817ffbfe6774f35b24893b6e54b54c3` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:47.160542 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e817ffbfe6774f35b24893b6e54b54c3)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:47.162459 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:47.367668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e817ffbfe6774f35b24893b6e54b54c3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:47.379651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e817ffbfe6774f35b24893b6e54b54c3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:47.387016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e817ffbfe6774f35b24893b6e54b54c3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:47.390668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e817ffbfe6774f35b24893b6e54b54c3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:47.467590 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e817ffbfe6774f35b24893b6e54b54c3'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:47.473984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1414/2850] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:47 2022] DELETE /identity/v3/users/e817ffbfe6774f35b24893b6e54b54c3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:47.479492 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:47.480066 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:47.480563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:47.499005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:47.500241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:47.561231 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1437/2851] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:47.572529 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:47.575162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:47.609100 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:47.637485 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb55fc-8f86-4f60-b29d-a026bef31c84 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:47.641264 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:47.641867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:47.642141 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:47.642409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:47.652775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:47.654245 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:47.664514 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1415/2852] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:48.171789 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:48.173526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:48.186593 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b3ad-9851-4d00-85f7-24db7e83aa0c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:48.191517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:48.202049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:48.202412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:48.202758 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] PATH_INFO: `/v3/projects/c6abbfea438d456d8b6b4fca7c446784` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:48.204393 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6abbfea438d456d8b6b4fca7c446784)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:48.206935 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:48.323837 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6abbfea438d456d8b6b4fca7c446784', 'request_id': 'req-a7b15fe0-b42d-42db-91b3-e584fa2eb237'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.330712 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6abbfea438d456d8b6b4fca7c446784', 'request_id': 'req-a7b15fe0-b42d-42db-91b3-e584fa2eb237'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.336637 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6abbfea438d456d8b6b4fca7c446784', 'request_id': 'req-a7b15fe0-b42d-42db-91b3-e584fa2eb237'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.419224 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] The token cache is being invalidate because project c6abbfea438d456d8b6b4fca7c446784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:48.419476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.420092 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.421607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1438/2853] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:48 2022] DELETE /identity/v3/projects/c6abbfea438d456d8b6b4fca7c446784 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:48.426012 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:48.439846 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2fe0-70df-49dd-9568-8b9a46ce0329 service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:48.499228 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:48.499858 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:48.500170 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:48.500447 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] PATH_INFO: `/v3/users/1a3c2ba824294984a25db56d6beb642d` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:48.501627 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3c2ba824294984a25db56d6beb642d)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:48.503557 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:48.722353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3c2ba824294984a25db56d6beb642d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.734685 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3c2ba824294984a25db56d6beb642d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.741651 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3c2ba824294984a25db56d6beb642d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.742346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3c2ba824294984a25db56d6beb642d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.800103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3c2ba824294984a25db56d6beb642d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:48.810658 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1416/2854] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:48 2022] DELETE /identity/v3/users/1a3c2ba824294984a25db56d6beb642d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:49.262473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:49.265626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:49.288521 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15fe0-b42d-42db-91b3-e584fa2eb237 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:49.365880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:49.366528 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:49.366804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:49.367071 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] PATH_INFO: `/v3/projects/52918b05a332446dab7801365b38e13a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:49.368249 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52918b05a332446dab7801365b38e13a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:49.370792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:49.394029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:49.487085 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52918b05a332446dab7801365b38e13a', 'request_id': 'req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.495081 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52918b05a332446dab7801365b38e13a', 'request_id': 'req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.502314 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52918b05a332446dab7801365b38e13a', 'request_id': 'req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.575180 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] The token cache is being invalidate because project 52918b05a332446dab7801365b38e13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:49.575555 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.576175 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.581744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1439/2855] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:49 2022] DELETE /identity/v3/projects/52918b05a332446dab7801365b38e13a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:49.587173 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:49.589281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:49.607973 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6379af-800a-4043-a834-fa4d0f2dc2af admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:49.659187 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:49.671953 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:49.672618 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:49.673026 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:49.673301 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] PATH_INFO: `/v3/users/2939ab3e703b473989737afc98255846` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:49.674460 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2939ab3e703b473989737afc98255846)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:49.676431 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:49.899686 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2939ab3e703b473989737afc98255846'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.914452 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2939ab3e703b473989737afc98255846'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.922564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2939ab3e703b473989737afc98255846'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.923930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2939ab3e703b473989737afc98255846'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.988085 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-ea5a86c1-5100-4cbc-9d4b-691e1b6663e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2939ab3e703b473989737afc98255846'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:49.998997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1417/2856] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:49 2022] DELETE /identity/v3/users/2939ab3e703b473989737afc98255846 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:50.415189 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:50.417112 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:50.434626 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fa497-a312-45e8-a8c2-e032ddc4e0b0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:50.500573 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:50.501212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:50.501503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:50.501778 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] PATH_INFO: `/v3/projects/e3700fb11fb7459d89b0072d314d893c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:50.502911 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3700fb11fb7459d89b0072d314d893c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:50.504832 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:50.625168 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3700fb11fb7459d89b0072d314d893c', 'request_id': 'req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:50.631342 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3700fb11fb7459d89b0072d314d893c', 'request_id': 'req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:50.637197 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3700fb11fb7459d89b0072d314d893c', 'request_id': 'req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:50.731020 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] The token cache is being invalidate because project e3700fb11fb7459d89b0072d314d893c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:50.737808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:50.737808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-a3c3ebeb-156a-49d2-b421-a3e8de2c50d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:50.737808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1440/2857] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:50 2022] DELETE /identity/v3/projects/e3700fb11fb7459d89b0072d314d893c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:50.738537 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:50.739004 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:50.739111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:50.759060 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:50.760340 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:50.826354 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1418/2858] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:50.839728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:50.839728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:50.839728 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:50.857655 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:50.858871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:50.866934 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1441/2859] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:50.871792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:50.881681 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249d78-e8ec-4781-8f15-25c8de5d88e5 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:50.886394 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:50.886994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:50.887325 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:50.887541 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:50.888208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:50.888509 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:50.890153 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:50.906350 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1419/2860] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:17:50.907515 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:50.918826 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeed2e-4eaf-4c06-8c05-ccb4508045b4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:50.923707 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:50.924389 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:50.924671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:50.924974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:50.925678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:50.927787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.168881 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1442/2861] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:50 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 08:17:51.175304 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:51.186115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9c0b0-41fb-4b1f-b36e-d15388ff6c3c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:51.236411 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:51.243260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:51.243875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.248979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.248979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.248979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:51.248979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.330772 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1420/2862] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:51 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:51.334932 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:51.345956 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f7d2-a081-4e24-99f3-faf160ab43d0 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:51.350634 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:51.351228 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.351525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.351796 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.352454 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:51.354062 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.355299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:51.364334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1443/2863] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:51.369559 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:51.378822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950deb2-3144-4dfc-affd-4a68ea1e8966 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:51.383804 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:51.384484 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.385738 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.385863 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.386463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:51.388072 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a4c4f-9d39-4b58-8348-66d8173b6150 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.398691 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1421/2864] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:51.403819 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:51.413554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7a65-4d45-484e-91f3-76df753bf1be admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:51.418623 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:51.421153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.421153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.421153 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] PATH_INFO: `/v3/projects/246ac586f4474a36b249d4a73f48beaf/users/3defd5583375467684cc672df625725d/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.434834 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246ac586f4474a36b249d4a73f48beaf, user_id=3defd5583375467684cc672df625725d, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:51.437474 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.539104 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1444/2865] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:51 2022] PUT /identity/v3/projects/246ac586f4474a36b249d4a73f48beaf/users/3defd5583375467684cc672df625725d/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:51.544785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.547756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.547756 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.566687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:51.567965 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:51.632647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1422/2866] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:51.643312 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:51.645334 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:51.704610 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598c43-5f55-4818-b604-7385a064f817 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:51.708379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:51.708983 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:51.709263 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:51.709533 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:51.719379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:51.720846 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:51.730507 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1445/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:52.422273 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:52.424494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:52.583171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcff29-a000-4432-b7dc-7c94090d00a3 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:52.590972 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:52.591715 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:52.592110 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:52.592463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:52.594575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:52.608778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:52.610615 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf16b1-a989-46b5-aaa3-684be0ee290d service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:52.625592 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1423/2868] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:53.499490 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:53.501561 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:53.523653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7adaa-c269-42e2-aeb6-579f37ca8bee service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:53.523930 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:53.524795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:53.525224 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:53.529173 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:53.531896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:53.531896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:53.531896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] PATH_INFO: `/v3/users/8e73d05272624502aa2a664cbe01e76f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:53.532400 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e73d05272624502aa2a664cbe01e76f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:53.534390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:53.556800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] MFA Rules not processed for user `3defd5583375467684cc672df625725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:53.558984 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:53.580505 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:53.625353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1424/2869] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:53.637451 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:53.642988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:53.705315 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ad55-d53e-45ac-b824-59ba73bcdeb4 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:53.709229 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:53.709853 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:53.710033 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e73d05272624502aa2a664cbe01e76f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:53.710155 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:53.710398 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:53.720401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:53.721870 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad6b2b-51e6-4e31-b9e7-0b1643f9dc08 service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:53.728069 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e73d05272624502aa2a664cbe01e76f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:53.732053 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1425/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:53.750240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e73d05272624502aa2a664cbe01e76f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:53.816065 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e73d05272624502aa2a664cbe01e76f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:53.816699 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e73d05272624502aa2a664cbe01e76f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:53.823824 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1446/2871] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:17:53 2022] DELETE /identity/v3/users/8e73d05272624502aa2a664cbe01e76f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:53.828562 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:53.828946 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:53.829293 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:53.848528 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:53.849743 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:53.911880 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1426/2872] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:53.922381 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:53.923902 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:53.976383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:53.982780 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996feec-a44d-4772-ad00-4b441a01270c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:53.986589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:53.987203 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:53.991687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:53.991687 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:53.996884 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:53.998345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a9eb-9b60-4322-b560-5ee424536388 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:54.007948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1447/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:54.670564 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:54.672069 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:54.689473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815501f-63fe-48e3-a547-523aaafa422b None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:54.689473 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:54.689811 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:54.690082 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:54.690362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] PATH_INFO: `/v3/projects/d0f2c5c728cf48d78069c7e4f3600bcc` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:54.691495 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f2c5c728cf48d78069c7e4f3600bcc)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:54.693466 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:54.818262 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f2c5c728cf48d78069c7e4f3600bcc', 'request_id': 'req-59448566-17ac-416e-8788-05a397866b33'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:54.909671 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f2c5c728cf48d78069c7e4f3600bcc', 'request_id': 'req-59448566-17ac-416e-8788-05a397866b33'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:54.917260 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f2c5c728cf48d78069c7e4f3600bcc', 'request_id': 'req-59448566-17ac-416e-8788-05a397866b33'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:54.919019 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:54.930117 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] The token cache is being invalidate because project d0f2c5c728cf48d78069c7e4f3600bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:17:54.930675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:54.931331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-59448566-17ac-416e-8788-05a397866b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:17:54.933814 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1427/2874] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:17:54 2022] DELETE /identity/v3/projects/d0f2c5c728cf48d78069c7e4f3600bcc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:17:54.938920 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:54.939448 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:54.939619 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:54.960227 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:54.961450 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:55.023387 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1448/2875] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:55.032979 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.037775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.037775 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.053570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:55.054845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:55.063238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1428/2876] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:55.067608 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.078291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234c766-caa1-4b6e-bd89-5cc240bd3975 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.084240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.084240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.084240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.084240 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.084792 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:17:55.085098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.086691 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.102451 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1449/2877] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:17:55.103588 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.114352 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86656a0-4acc-4060-bc94-76d5c6918870 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.121236 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.121942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.122331 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.122647 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.123922 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.125933 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.254214 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1429/2878] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:17:55 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:55.258433 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.269598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a415-4a6c-45c6-80df-8c928c11d85a admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.332434 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.333044 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.333323 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.333596 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.334221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.336124 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.428501 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1450/2879] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:17:55 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:17:55.433223 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.453368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702bac3-3172-4b10-9a81-f7ad26100295 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.453368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.453368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.453368 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.453949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.453949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.455294 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.469600 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1430/2880] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:55.473366 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.487280 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfec1c-25c1-4724-9ee1-13b9770879c9 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.492864 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.493609 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.493900 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.494177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.494896 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.496948 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8a8b3-5104-4f38-b7c8-b852acb36c43 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.511265 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1451/2881] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:17:55.515353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.538815 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde261-2237-4a1e-ac6e-086b4252e1c5 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.543412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285300-c2ca-419d-bfab-2df33d2b310e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.543701 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285300-c2ca-419d-bfab-2df33d2b310e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.543974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285300-c2ca-419d-bfab-2df33d2b310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.550652 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.551337 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] REQUEST_METHOD: `PUT` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.551621 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.551894 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] PATH_INFO: `/v3/projects/3249ddc4cca24d2ba6828833cca72bd0/users/af820b1b5ff946eba54363ceb94caa27/roles/b086728fbde044b28647906c294e9a64` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.565823 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a0285300-c2ca-419d-bfab-2df33d2b310e None None] MFA Rules not processed for user `3defd5583375467684cc672df625725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:55.567083 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a0285300-c2ca-419d-bfab-2df33d2b310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:55.571852 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3249ddc4cca24d2ba6828833cca72bd0, user_id=af820b1b5ff946eba54363ceb94caa27, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.575476 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.623542 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:17:55.631307 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1452/2882] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:17:55.645499 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1431/2883] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:17:55 2022] PUT /identity/v3/projects/3249ddc4cca24d2ba6828833cca72bd0/users/af820b1b5ff946eba54363ceb94caa27/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:17:55.656828 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.657105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.657383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.687310 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] MFA Rules not processed for user `af820b1b5ff946eba54363ceb94caa27`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:17:55.688534 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:55.755340 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1453/2884] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:17:55.767288 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:55.769045 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:55.834284 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efc90-5538-4c79-93a7-37476375303c admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:55.838800 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:55.839653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:55.839942 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:55.840379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:55.849963 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:55.856978 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:55.865320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1432/2885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:17:56.080928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:17:56.080928 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:56.179001 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788775d-d0fd-4c60-8970-e28885e20a9a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:17:56.184958 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:17:56.185554 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:17:56.185836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:17:56.186105 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:17:56.187798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:17:56.200140 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:17:56.201797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:17:56.211676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1454/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:17:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:05.858500 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:06.207408 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=73 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:06.354412 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:06.356823 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:06.424639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433da02-86ae-47af-8ee7-d62620127c5e service cinder] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:06.429635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:06.430281 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:06.430587 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:06.430867 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] PATH_INFO: `/v3/users/36db0107468342cd8165af75828bb9eb` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:06.432049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=36db0107468342cd8165af75828bb9eb)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:06.436569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:06.640344 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36db0107468342cd8165af75828bb9eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:06.653518 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36db0107468342cd8165af75828bb9eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:06.660604 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36db0107468342cd8165af75828bb9eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:06.661374 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36db0107468342cd8165af75828bb9eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:06.724952 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36db0107468342cd8165af75828bb9eb'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:06.732430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1433/2887] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:18:06 2022] DELETE /identity/v3/users/36db0107468342cd8165af75828bb9eb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:07.011755 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:07.023029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c08f1-3fe9-4fe3-9ab0-ca3fbf6d9703 service placement] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:07.118961 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:07.121764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:07.121764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:07.121764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] PATH_INFO: `/v3/projects/e9958db40df148d288aac408957a8031` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:07.122053 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9958db40df148d288aac408957a8031)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:07.125145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:07.241678 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9958db40df148d288aac408957a8031', 'request_id': 'req-5a358408-3f61-4bdd-8c05-5779b77f895f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.248795 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9958db40df148d288aac408957a8031', 'request_id': 'req-5a358408-3f61-4bdd-8c05-5779b77f895f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.254874 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9958db40df148d288aac408957a8031', 'request_id': 'req-5a358408-3f61-4bdd-8c05-5779b77f895f'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.337797 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] The token cache is being invalidate because project e9958db40df148d288aac408957a8031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:18:07.338115 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.338743 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.340839 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1455/2888] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:18:07 2022] DELETE /identity/v3/projects/e9958db40df148d288aac408957a8031 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:07.344961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:07.346379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:07.360554 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a030b-8083-46f7-8ce7-962bd25f4fcb admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:07.416221 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:07.416850 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:07.417126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:07.417395 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] PATH_INFO: `/v3/users/bd26dcd49b104eef91a4d49a8e607491` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:07.419231 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd26dcd49b104eef91a4d49a8e607491)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:07.421251 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:07.442895 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:07.626822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd26dcd49b104eef91a4d49a8e607491'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.639107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd26dcd49b104eef91a4d49a8e607491'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.646426 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd26dcd49b104eef91a4d49a8e607491'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.647362 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd26dcd49b104eef91a4d49a8e607491'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.716135 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd26dcd49b104eef91a4d49a8e607491'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:07.722175 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1434/2889] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:18:07 2022] DELETE /identity/v3/users/bd26dcd49b104eef91a4d49a8e607491 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:07.962734 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:07.964217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:07.981025 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358408-3f61-4bdd-8c05-5779b77f895f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:08.039005 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:08.039638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:08.039923 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:08.040229 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] PATH_INFO: `/v3/projects/5825f22405c74e9ebcea300404a6956d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:08.041333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5825f22405c74e9ebcea300404a6956d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:08.043291 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:08.148771 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:08.163414 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5825f22405c74e9ebcea300404a6956d', 'request_id': 'req-55d7ec47-3dca-4c8a-9090-01213ddf689d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:08.170129 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5825f22405c74e9ebcea300404a6956d', 'request_id': 'req-55d7ec47-3dca-4c8a-9090-01213ddf689d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:08.175836 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5825f22405c74e9ebcea300404a6956d', 'request_id': 'req-55d7ec47-3dca-4c8a-9090-01213ddf689d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:08.272993 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] The token cache is being invalidate because project 5825f22405c74e9ebcea300404a6956d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:18:08.273586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:08.276251 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-55d7ec47-3dca-4c8a-9090-01213ddf689d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:08.278842 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1456/2890] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:18:07 2022] DELETE /identity/v3/projects/5825f22405c74e9ebcea300404a6956d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:11.120390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:11.121840 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:11.135874 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e0cf-d8d3-4b3f-8ba1-af189507ad90 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:11.193754 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:11.194320 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:11.194602 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:11.194875 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] PATH_INFO: `/v3/users/af820b1b5ff946eba54363ceb94caa27` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:11.196015 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af820b1b5ff946eba54363ceb94caa27)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:11.197940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:11.374474 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af820b1b5ff946eba54363ceb94caa27'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:11.389330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af820b1b5ff946eba54363ceb94caa27'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:11.397250 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af820b1b5ff946eba54363ceb94caa27'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:11.398103 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af820b1b5ff946eba54363ceb94caa27'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:11.462172 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af820b1b5ff946eba54363ceb94caa27'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:11.470873 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1435/2891] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:18:11 2022] DELETE /identity/v3/users/af820b1b5ff946eba54363ceb94caa27 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:11.475329 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:11.475827 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:11.476122 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:11.498563 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:11.500047 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:11.561390 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1457/2892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:11.569899 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:11.571287 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:11.595208 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:11.651174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63635d-a56f-4fd7-aa44-b0d91eb2e353 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:11.655613 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:11.656274 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:11.656558 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:11.656847 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:11.666291 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:11.669377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcd469-9aca-4fae-8251-f6019d04cdd6 service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:11.677446 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1436/2893] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:12.116897 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.120871 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:12.130419 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd67f3-09da-43bd-afc3-b7a1f25573e8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.135382 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.136039 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.136322 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.136589 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] PATH_INFO: `/v3/projects/3249ddc4cca24d2ba6828833cca72bd0` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.137978 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3249ddc4cca24d2ba6828833cca72bd0)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.139887 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.270652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3249ddc4cca24d2ba6828833cca72bd0', 'request_id': 'req-2129b210-06c8-405b-a7c3-fd33b092f0d6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:12.283653 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3249ddc4cca24d2ba6828833cca72bd0', 'request_id': 'req-2129b210-06c8-405b-a7c3-fd33b092f0d6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:12.291753 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3249ddc4cca24d2ba6828833cca72bd0', 'request_id': 'req-2129b210-06c8-405b-a7c3-fd33b092f0d6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:12.359269 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] The token cache is being invalidate because project 3249ddc4cca24d2ba6828833cca72bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:18:12.359565 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:12.360268 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-2129b210-06c8-405b-a7c3-fd33b092f0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:18:12.361764 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1458/2894] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:18:12 2022] DELETE /identity/v3/projects/3249ddc4cca24d2ba6828833cca72bd0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:18:12.371947 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.372620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.372620 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.392146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:12.393359 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:12.459513 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1437/2895] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:12.469774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.470055 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.470321 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.495431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:12.496306 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:12.505748 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1459/2896] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:12.510065 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.520798 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048647-924f-4456-a7db-c6f74c521954 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.525346 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.525940 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.526216 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.526494 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.527134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81518) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 08:18:12.527435 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.530010 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.541360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1438/2897] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Sep 13 08:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 08:18:12.546003 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.555090 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137c785-260f-414c-9377-6eeded0632f6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.560559 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.561152 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.561438 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.561713 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.562339 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.564248 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.672506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1460/2898] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Sep 13 08:18:12 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:18:12.676827 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.687238 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998c41b-f3c9-4ffc-a83d-c5ba7fcaf6e7 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.745683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.746296 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.746576 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.746883 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] PATH_INFO: `/v3/users` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.747785 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.749734 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.827967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1439/2899] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Sep 13 08:18:12 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 08:18:12.832077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.843119 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c865d-2dcf-4e2f-9c4b-4ba5d18b0bc7 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.848138 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.848787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.849067 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.849341 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.850134 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.851736 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.862638 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1461/2900] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:18:12.867526 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.878397 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a6e0b-fd16-4c8e-a812-e5db20a54182 admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.883690 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.884347 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.884656 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.884932 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.885585 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.887200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb535093-81ec-4825-8ecb-abbdda3ef2b7 admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:12.899848 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1440/2901] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Sep 13 08:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 08:18:12.905202 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:12.911200 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:12.915333 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db971eaf-c373-46f3-b6d5-917b02c801ba admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:12.921562 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:12.922261 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:12.922603 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:12.922804 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] PATH_INFO: `/v3/projects/e4bcbedb88714605b218509307b79f54/users/8ae1fac2a6cf49b19796b46193fcd26a/roles/b086728fbde044b28647906c294e9a64` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:12.937744 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bcbedb88714605b218509307b79f54, user_id=8ae1fac2a6cf49b19796b46193fcd26a, role_id=b086728fbde044b28647906c294e9a64)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:12.940394 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:13.040890 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1462/2902] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Sep 13 08:18:12 2022] PUT /identity/v3/projects/e4bcbedb88714605b218509307b79f54/users/8ae1fac2a6cf49b19796b46193fcd26a/roles/b086728fbde044b28647906c294e9a64 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 08:18:13.046124 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeaf1b-84be-43aa-b9dd-996b8003aceb None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:13.046430 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeaf1b-84be-43aa-b9dd-996b8003aceb None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:13.046704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeaf1b-84be-43aa-b9dd-996b8003aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:13.060845 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:13.067034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-67aeaf1b-84be-43aa-b9dd-996b8003aceb None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:13.068302 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-67aeaf1b-84be-43aa-b9dd-996b8003aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:13.137332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1441/2903] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:13.147711 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:13.149676 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:13.209669 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236c4f-bc65-4b28-9d10-bcfbbaaf8759 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:13.213172 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:13.213781 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:13.214095 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:13.214375 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:13.223345 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:13.224798 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:13.234945 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1463/2904] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:14.538401 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6044e6-9571-4a71-926e-baeea29cf185 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:14.538954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6044e6-9571-4a71-926e-baeea29cf185 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:14.538954 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6044e6-9571-4a71-926e-baeea29cf185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:14.575504 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-0f6044e6-9571-4a71-926e-baeea29cf185 None None] MFA Rules not processed for user `8ae1fac2a6cf49b19796b46193fcd26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:14.576836 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-0f6044e6-9571-4a71-926e-baeea29cf185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:14.646868 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1442/2905] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:14.658015 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:14.659392 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:14.745220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9216b-d3c7-4a20-b02d-2aecaeb0167d service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:14.750673 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '840b8207e53043a8bab349f03f6ac109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:14.751299 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:14.751579 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:14.751854 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:14.760324 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:14.761787 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3692ff-83ab-42ef-97ec-f56194a1c5fa service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:14.770841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1464/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:16.543034 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:16.543550 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:16.544075 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:16.564598 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] MFA Rules not processed for user `8ae1fac2a6cf49b19796b46193fcd26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:16.565795 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:16.572909 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1443/2907] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:24.766831 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:26.558680 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=59 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:28.102276 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbc21-59b6-463b-85df-9a113acb4174 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:28.102883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbc21-59b6-463b-85df-9a113acb4174 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:28.102883 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdbc21-59b6-463b-85df-9a113acb4174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:28.122118 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a8cdbc21-59b6-463b-85df-9a113acb4174 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:28.123309 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a8cdbc21-59b6-463b-85df-9a113acb4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:28.131255 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1465/2908] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:28.153826 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:28.155259 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:28.234080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a8b7-75da-4e60-b837-3ac62bfa5b1f None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:28.239640 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:28.240272 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:28.240556 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:28.240849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:28.249049 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:28.250635 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:28.261727 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1444/2909] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:33.483557 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386336-4707-425c-954e-18cbf5e98bc1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:33.484148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386336-4707-425c-954e-18cbf5e98bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:33.484148 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386336-4707-425c-954e-18cbf5e98bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:33.504784 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8b386336-4707-425c-954e-18cbf5e98bc1 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:33.505981 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8b386336-4707-425c-954e-18cbf5e98bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:33.513942 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1466/2910] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:33.528755 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:33.530212 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:33.545488 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747117db-af77-42e3-9ef9-4d36b25fc371 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:33.551778 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:33.552403 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:33.552687 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:33.552960 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:33.561188 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:33.562749 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:33.573605 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1445/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:36.868575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351661-b86b-48c3-b8a2-0a4e4e064f0f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:36.869221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351661-b86b-48c3-b8a2-0a4e4e064f0f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:36.869221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351661-b86b-48c3-b8a2-0a4e4e064f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:36.888957 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e1351661-b86b-48c3-b8a2-0a4e4e064f0f None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:36.890137 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e1351661-b86b-48c3-b8a2-0a4e4e064f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:36.898185 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1467/2912] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:36.938338 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:36.950182 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338bb1f-1a03-44aa-8ca7-9d745ddb7625 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:36.955797 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:36.956420 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:36.956696 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:36.956961 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:36.966016 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:36.967575 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98350-ab2b-43f3-a95e-63635667eed7 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:36.977330 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1446/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:37.024478 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:37.024766 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:37.025040 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:37.045915 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] MFA Rules not processed for user `8ae1fac2a6cf49b19796b46193fcd26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:37.047117 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:37.055133 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1468/2914] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:39.799038 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d625-1e02-45df-921e-1d36d9a40c4a None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:39.799914 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d625-1e02-45df-921e-1d36d9a40c4a None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:39.800379 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d625-1e02-45df-921e-1d36d9a40c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:39.827789 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-3cb7d625-1e02-45df-921e-1d36d9a40c4a None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:39.829126 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-3cb7d625-1e02-45df-921e-1d36d9a40c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:39.837967 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1447/2915] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:39.860657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:39.874473 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389871d-7fe1-45ea-bc33-4aa700f9af4b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:39.880401 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:39.880970 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:39.881245 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:39.881540 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:39.889892 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:39.893082 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:39.906292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1469/2916] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:43.055171 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b266-eaeb-423e-b7fa-8f081f9f76ea None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:43.055701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b266-eaeb-423e-b7fa-8f081f9f76ea None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:43.055701 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b266-eaeb-423e-b7fa-8f081f9f76ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:43.076218 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-a5e7b266-eaeb-423e-b7fa-8f081f9f76ea None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:43.077408 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-a5e7b266-eaeb-423e-b7fa-8f081f9f76ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:43.085467 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1448/2917] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:43.108086 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:43.119769 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2e1ba-1c62-444a-9322-3002b2494002 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:43.125397 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:43.125936 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:43.126217 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:43.126517 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:43.135930 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:43.137526 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:43.148145 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1470/2918] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:46.281480 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ce71-e218-4957-9a4a-d1c515d3d560 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:46.281911 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ce71-e218-4957-9a4a-d1c515d3d560 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:46.287365 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ce71-e218-4957-9a4a-d1c515d3d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:46.301824 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-7be2ce71-e218-4957-9a4a-d1c515d3d560 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:18:46.303061 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-7be2ce71-e218-4957-9a4a-d1c515d3d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:18:46.316035 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1449/2919] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:18:46.345235 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:18:46.356783 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564985c6-db15-48bd-abd0-a7da26642411 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:18:46.362407 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:18:46.363011 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:18:46.363292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:18:46.363567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:18:46.372212 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:18:46.373967 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:18:46.384575 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1471/2920] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:18:56.296201 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=55 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:56.379303 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=30 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:03.782486 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b659d-89c6-4408-8d17-4f2431143a32 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:03.782949 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b659d-89c6-4408-8d17-4f2431143a32 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:03.783063 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b659d-89c6-4408-8d17-4f2431143a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:03.812793 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-f31b659d-89c6-4408-8d17-4f2431143a32 None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:03.814409 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f31b659d-89c6-4408-8d17-4f2431143a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:03.870842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1450/2921] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Sep 13 08:19:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:04.013493 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:04.014974 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:04.085360 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e096305-47eb-47c5-b692-c224cfa7ad80 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:04.090545 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:04.091301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:04.091586 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:04.091862 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:04.100186 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:04.101762 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c584b4-c976-450f-8768-aece891d4919 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:04.110412 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1472/2922] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:19:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:19:05.895988 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] REQUEST_METHOD: `POST` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:05.896675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:05.896675 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:05.929449 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.auth.core [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] MFA Rules not processed for user `3defd5583375467684cc672df625725d`. Rule list: `[]` (Enabled: `True`). {{(pid=81518) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:05.932240 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:06.019912 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1451/2923] 10.222.0.43 () {58 vars in 958 bytes} [Tue Sep 13 08:19:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:14.107131 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=32 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:16.005008 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=54 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:21.408196 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144315d8-30c4-4b45-906c-54e40344641b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:21.408656 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144315d8-30c4-4b45-906c-54e40344641b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:21.408773 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144315d8-30c4-4b45-906c-54e40344641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:21.428443 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-144315d8-30c4-4b45-906c-54e40344641b None None] MFA Rules not processed for user `1a0ea18309fb47cfa5efe4f6f95beec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:21.429652 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-144315d8-30c4-4b45-906c-54e40344641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:21.437697 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1473/2924] 10.222.0.43 () {58 vars in 967 bytes} [Tue Sep 13 08:19:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:21.450548 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:21.462653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813efbf-2393-45e0-91b7-7b185acf5406 None None] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:21.468235 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085da9bf0ef94bf89f7254dd67301a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:21.468835 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:21.469115 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:21.469388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:21.477332 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:21.479872 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:21.487822 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1452/2925] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Sep 13 08:19:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 08:19:22.597292 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:22.597814 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:22.597913 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:22.618254 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:22.620503 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:22.628413 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1474/2926] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:22.642569 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:22.655821 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c7c81-c32a-474e-9e60-35c97a34e415 service swift] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:22.661194 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:22.661849 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:22.662174 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:22.662400 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:22.671364 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:22.672994 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:22.682305 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1453/2927] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:19:24.482077 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:24.491774 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f9ff-0596-44ce-aa41-39fc55e1f859 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:24.497178 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:24.497816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:24.498098 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:24.498370 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] PATH_INFO: `/v3/users/8ae1fac2a6cf49b19796b46193fcd26a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:24.499497 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae1fac2a6cf49b19796b46193fcd26a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:24.501567 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:24.677646 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae1fac2a6cf49b19796b46193fcd26a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:24.689841 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae1fac2a6cf49b19796b46193fcd26a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:24.696519 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae1fac2a6cf49b19796b46193fcd26a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:24.749222 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae1fac2a6cf49b19796b46193fcd26a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:24.749880 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-7cc78c1b-caa8-4816-ac55-f55909177ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae1fac2a6cf49b19796b46193fcd26a'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:24.755937 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1475/2928] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:19:24 2022] DELETE /identity/v3/users/8ae1fac2a6cf49b19796b46193fcd26a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:19:25.274997 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:25.301197 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc26f78-f5de-4b61-a91e-4a6f4f20f8ac service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:25.364444 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:25.365107 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:25.365390 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:25.365668 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] PATH_INFO: `/v3/projects/e4bcbedb88714605b218509307b79f54` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:25.366791 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bcbedb88714605b218509307b79f54)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:25.368802 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:25.516048 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bcbedb88714605b218509307b79f54', 'request_id': 'req-4d76b476-71ad-44e3-b187-bffef276035d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:25.603349 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bcbedb88714605b218509307b79f54', 'request_id': 'req-4d76b476-71ad-44e3-b187-bffef276035d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:25.610111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bcbedb88714605b218509307b79f54', 'request_id': 'req-4d76b476-71ad-44e3-b187-bffef276035d'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:25.621277 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] The token cache is being invalidate because project e4bcbedb88714605b218509307b79f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:19:25.621568 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:25.622210 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:19:25.623714 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1454/2929] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:19:25 2022] DELETE /identity/v3/projects/e4bcbedb88714605b218509307b79f54 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:19:26.134510 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc50ba-67b2-4459-8830-b1608a2fb1c8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:26.135108 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc50ba-67b2-4459-8830-b1608a2fb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:26.135220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc50ba-67b2-4459-8830-b1608a2fb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:26.156431 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5dcc50ba-67b2-4459-8830-b1608a2fb1c8 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:26.157622 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5dcc50ba-67b2-4459-8830-b1608a2fb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:26.217671 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1476/2930] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 08:19:26.241757 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:26.243130 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:26.312162 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:26.318160 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b476-71ad-44e3-b187-bffef276035d admin admin] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:26.325104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:26.325104 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:26.325361 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:26.325463 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:26.333470 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:26.335040 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:26.344649 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1455/2931] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:19:29.017009 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b672-c3b8-4486-a8be-383443bdae17 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:29.017499 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b672-c3b8-4486-a8be-383443bdae17 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:29.017605 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b672-c3b8-4486-a8be-383443bdae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:29.037549 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3725b672-c3b8-4486-a8be-383443bdae17 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:29.038746 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3725b672-c3b8-4486-a8be-383443bdae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:29.047220 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1477/2932] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:29.065353 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:29.066860 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:29.082151 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160a508-55c5-4f01-98af-378c48279612 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:29.087683 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:29.093689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:29.093689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:29.093689 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:29.097704 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:29.099298 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:29.109455 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1456/2933] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:19:32.226308 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac350-8ebb-439e-8188-9978b5b0e5b7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:32.226791 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac350-8ebb-439e-8188-9978b5b0e5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:32.226908 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac350-8ebb-439e-8188-9978b5b0e5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:32.246800 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-4eeac350-8ebb-439e-8188-9978b5b0e5b7 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:32.249164 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4eeac350-8ebb-439e-8188-9978b5b0e5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:32.256959 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1478/2934] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:32.280080 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:32.291211 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fcfc-7691-49b5-99b8-a5cafe5577b9 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:32.296761 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:32.297377 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:32.297653 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:32.297924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:32.305885 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:32.307448 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:32.317561 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1457/2935] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:19:35.492019 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:35.492574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:35.492574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:35.512816 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] MFA Rules not processed for user `3938cf1c8bd54a1e841528f9f40a833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 08:19:35.514483 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:35.522301 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1479/2936] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Sep 13 08:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 08:19:35.561631 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:35.572669 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee6d2-dba8-4af7-ab28-4b513b14bd77 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:35.578058 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f3b6c53dcc844c784c17f6c4af76bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:35.578639 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:35.578921 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:35.579190 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:35.587050 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:35.588626 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:35.597764 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1458/2937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:19:40.324582 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:40.326029 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:40.369049 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:40.383177 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237317-8f64-4d77-b8d2-41786c56e443 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:40.386756 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:40.387354 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:40.387632 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:40.387905 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:40.390662 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:40.404657 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:40.406304 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:40.417038 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1480/2938] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 08:19:41.597999 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:19:41.599388 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:41.611563 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e70f-7941-414f-9a43-a8d25cc2d212 service nova] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:19:41.615232 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68e7eaa644d2aa9616ba1dde8fd95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:19:41.615831 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] REQUEST_METHOD: `GET` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:19:41.616157 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:19:41.616433 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:19:41.618111 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.fernet_utils [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81518) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:19:41.631472 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:19:41.632924 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:19:41.644421 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1459/2939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:19:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:19:50.460250 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=8 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:19:51.638842 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=29 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:20:07.965598 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:20:07.967383 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:20:07.982377 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee216-fba5-47b6-b7f1-07b90d7657be service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:20:07.986953 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:20:07.987616 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:20:07.987899 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:20:07.988206 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] PATH_INFO: `/v3/users/3defd5583375467684cc672df625725d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:20:07.989524 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3defd5583375467684cc672df625725d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:20:07.991525 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:20:08.159410 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3defd5583375467684cc672df625725d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.172241 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3defd5583375467684cc672df625725d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.179805 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3defd5583375467684cc672df625725d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.253741 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3defd5583375467684cc672df625725d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.254380 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3defd5583375467684cc672df625725d'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.260985 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1481/2940] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Sep 13 08:20:07 2022] DELETE /identity/v3/users/3defd5583375467684cc672df625725d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:20:08.501146 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] Authenticating user token {{(pid=81518) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:20:08.512643 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8939-759d-40ba-b007-0b8919a4dd8d service neutron] Validating token access rules against request {{(pid=81518) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:20:08.569792 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938cf1c8bd54a1e841528f9f40a833f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e508fcc9dce499eae1e042c37e06fe3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81518) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:20:08.570424 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:20:08.570705 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] SCRIPT_NAME: `/identity` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:20:08.570981 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] PATH_INFO: `/v3/projects/246ac586f4474a36b249d4a73f48beaf` {{(pid=81518) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:20:08.572134 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] RBAC: Authorizing `identity:delete_project(project_id=246ac586f4474a36b249d4a73f48beaf)` {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:20:08.574022 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] RBAC: Authorization granted {{(pid=81518) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:20:08.677042 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246ac586f4474a36b249d4a73f48beaf', 'request_id': 'req-f98f1b4e-5b35-41e8-8807-b89a71c0127e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.745360 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246ac586f4474a36b249d4a73f48beaf', 'request_id': 'req-f98f1b4e-5b35-41e8-8807-b89a71c0127e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.752200 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246ac586f4474a36b249d4a73f48beaf', 'request_id': 'req-f98f1b4e-5b35-41e8-8807-b89a71c0127e'} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.762531 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] The token cache is being invalidate because project 246ac586f4474a36b249d4a73f48beaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81518) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 08:20:08.766844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.766844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG keystone.notifications [None req-f98f1b4e-5b35-41e8-8807-b89a71c0127e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81518) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 08:20:08.766844 dv-cinder-857075-3-smb devstack@keystone.service[81518]: [pid: 81518|app: 0|req: 1460/2941] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Sep 13 08:20:08 2022] DELETE /identity/v3/projects/246ac586f4474a36b249d4a73f48beaf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 08:20:18.257506 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:20:18.759570 dv-cinder-857075-3-smb devstack@keystone.service[81518]: DEBUG dbcounter [-] [81518] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:23:55.867574 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 08:23:55.868995 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:23:55.937017 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258d080-115b-46d7-b562-842795cc16f5 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 08:23:56.000607 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '924118f361c54787b3eb164a7789137e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507dc049d82d4cf18a1694f3fc00a31f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 08:23:56.001221 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 08:23:56.001498 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 08:23:56.001765 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 08:23:56.003476 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 08:23:56.015335 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 08:23:56.016808 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cc6ab-c660-4f9d-a5b3-63f605a83155 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 08:23:56.026670 dv-cinder-857075-3-smb devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1482/2942] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Sep 13 08:23:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 08:24:06.022379 dv-cinder-857075-3-smb devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=58 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}